-- Logs begin at Mon 2022-05-23 17:11:13 UTC, end at Mon 2022-05-23 18:32:34 UTC. -- May 23 17:58:41.019153 dv-cinder-750782-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 17:58:41.027873 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 17:58:41 2022] *** May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: nodename: dv-cinder-750782-23-iscsi May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: machine: x86_64 May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: clock source: unix May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: pcre jit disabled May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: detected number of CPU cores: 4 May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: current working directory: / May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: detected binary path: /usr/bin/uwsgi-core May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: your processes number limit is 47680 May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: your memory page size is 4096 bytes May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: detected max file descriptor number: 2048 May 23 17:58:41.029960 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: lock engine: pthread robust mutexes May 23 17:58:41.031587 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: thunder lock: enabled May 23 17:58:41.031587 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 17:58:41.031587 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 17:58:41.075482 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: Python main interpreter initialized at 0x56273159c9c0 May 23 17:58:41.075482 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: python threads support enabled May 23 17:58:41.075482 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: your server socket listen backlog is limited to 100 connections May 23 17:58:41.075482 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: your mercy for graceful operations on workers is 90 seconds May 23 17:58:41.075882 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: mapped 403077 bytes (393 KB) for 2 cores May 23 17:58:41.075882 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: *** Operational MODE: preforking *** May 23 17:58:41.076155 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: *** uWSGI is running in multiple interpreter mode *** May 23 17:58:41.076155 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: spawned uWSGI master process (pid: 103500) May 23 17:58:41.076368 dv-cinder-750782-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 17:58:41.076938 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: spawned uWSGI worker 1 (pid: 103501, cores: 1) May 23 17:58:41.078588 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: spawned uWSGI worker 2 (pid: 103502, cores: 1) May 23 17:58:41.078588 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 17:58:42.264502 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 17:58:42.268081 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 17:58:42.995671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:58:42.995671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: from cryptography.utils import int_from_bytes May 23 17:58:42.996002 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:58:42.996002 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: from cryptography.utils import int_from_bytes May 23 17:58:42.996527 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:58:42.996527 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: from cryptography.utils import int_from_bytes May 23 17:58:42.996854 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:58:42.996854 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: from cryptography.utils import int_from_bytes May 23 17:58:45.623075 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:58:45.623615 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:58:45.623836 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:58:45.624096 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:58:45.624456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:58:45.624550 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:58:45.624637 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:58:45.624807 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.624901 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:58:45.625131 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.625218 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:58:45.625451 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.625547 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:58:45.625769 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.625857 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.626098 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.626185 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.626408 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.626501 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.626744 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.626833 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.627064 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.627158 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.627391 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.627484 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.627652 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.627739 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.627966 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.628078 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.628288 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-23-iscsi {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.628378 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.628609 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.628695 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.628914 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.629008 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.629224 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.629562 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-23-iscsi {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.629792 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.629884 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.630096 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.630193 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.630403 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.630498 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.630737 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.630835 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.631049 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.631233 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.631631 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.631761 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.631867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.631980 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.632166 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.632294 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.632476 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.632624 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.632780 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.632939 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.633070 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.633158 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.633415 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.633500 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.633735 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.633833 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.634054 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.634150 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.634359 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.634449 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.634685 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.634828 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-23-iscsi {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.635035 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.635133 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.635352 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.635448 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.635667 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.635751 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-23-iscsi {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.636051 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.636143 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.636370 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.636461 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.636677 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.636771 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.637632 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.637856 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.637951 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.638253 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.638347 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.638569 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.638655 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.638916 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.639014 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.639239 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.639338 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.639551 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.639635 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.639849 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.639945 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.640158 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.640257 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.640470 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.640557 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.640791 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.640898 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.641094 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.641189 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.641399 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.641486 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.641651 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.641737 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.641957 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.642045 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.642279 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.642371 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.642601 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.642686 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.642885 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.642986 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.643185 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.643278 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.643436 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.643537 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.643756 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.643849 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.644076 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.644162 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.644375 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.644462 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.644632 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.644718 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.644964 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.645057 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.645266 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.645352 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.645572 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.645659 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.645879 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.645964 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.646184 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.646270 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.646491 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.646582 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.646827 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.646937 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.647141 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.647232 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.647448 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.647540 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.647756 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.647850 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.648077 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.648164 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.648393 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.648477 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.648711 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.648807 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.649020 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.649116 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.649343 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.649435 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.649659 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.649760 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.649966 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.650059 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.650286 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.650372 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.650609 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.650717 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.650946 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.651074 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.651253 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.651351 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.651558 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.651654 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.651876 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.651969 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.652186 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.652278 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.652548 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.652665 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.652835 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.652973 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.653139 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.653296 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.653443 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.653630 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.653763 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.653945 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.654067 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.654205 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.654374 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.654517 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.654681 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.654858 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.655003 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.655189 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.655309 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.655504 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.655605 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.655819 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.655904 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.656132 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.656230 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.656441 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.656534 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.656757 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.656850 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.657063 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.657149 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.657369 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.657455 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.657674 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.657761 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.657983 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.658069 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.658296 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.658381 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.658598 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.658790 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.658928 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.659015 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.659232 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.659327 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.659536 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.659633 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.659857 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.659943 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.660161 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.660245 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.660468 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.660561 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.660780 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.660876 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.661085 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.661192 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.661387 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.661472 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.661701 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.661788 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.662006 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.662121 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.662311 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.662422 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.662624 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.662738 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.662947 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.663038 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.663252 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.663364 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.663567 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.663658 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.663868 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.663959 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.664174 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.664277 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.664475 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.664581 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.664777 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.664869 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.665080 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.665182 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.665383 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.665474 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.665684 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.665785 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.665985 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.666085 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.666282 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.666374 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.666587 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.666678 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.666924 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.667017 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.667228 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.667318 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.667532 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.667623 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.667834 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.667925 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.668180 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.668273 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.668515 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.668608 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.668824 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.669005 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.669137 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.669351 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.669439 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.669670 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.669766 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:58:45.670007 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.670095 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.670347 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.670448 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.670665 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.670838 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.671003 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.671106 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.671318 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.671427 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.671647 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.671746 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.671960 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.672047 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.672276 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.672378 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.672589 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.672676 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.672908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.672994 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.673227 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.673321 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.673555 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.673648 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.673869 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.673975 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.674188 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.674275 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.674506 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.674594 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.674842 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.674933 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.675162 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.675267 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.675488 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.675575 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.675805 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.675898 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.676118 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.676222 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.676446 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.676540 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.676782 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.676881 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.677093 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.677191 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.677412 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.677510 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.677730 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.677815 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.678042 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.678137 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.678354 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.678440 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.678664 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.678772 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.679010 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.679110 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.679343 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.679430 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.679657 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.679745 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.679969 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.680057 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.680283 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.680427 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.680596 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.680684 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.680906 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.680993 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.681216 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.681302 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.681527 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.681616 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.681843 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.681936 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.682159 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.682245 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.682468 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.682598 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.682801 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.682905 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.683118 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.683204 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.683429 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.683527 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.684277 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.684435 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.684586 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.684722 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.684875 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.684973 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.685180 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.685267 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.685487 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.685572 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.685795 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.685900 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.686098 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.686184 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.686406 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.686493 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.686737 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.686839 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.687044 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.687137 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.687355 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.687440 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.687670 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.687755 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.687980 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.688066 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.688291 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.688378 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.688601 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.688688 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.688905 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.689048 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.689214 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.689301 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.689524 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.689619 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.689829 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.689915 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.690139 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.690225 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.690449 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.690535 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.690780 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.690882 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.691092 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.691196 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.691393 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.691514 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.691699 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.691795 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.692006 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.692102 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.692314 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.692402 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.692623 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.692745 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.692929 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.693024 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.693236 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.693329 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.693550 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.693635 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.693859 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.693945 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.694171 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.694257 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.694483 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.694568 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.694844 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.694935 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.695148 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.695232 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.695473 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.695570 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.695797 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.695885 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.696113 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.696198 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.696418 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.696505 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.696727 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.696814 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.697033 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.697118 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.697336 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.697422 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.697639 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.697732 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.697946 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.698031 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.698249 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.698347 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.698551 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.698644 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.698879 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.698967 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.699183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.699281 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.700028 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.700116 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.700343 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.700429 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.700655 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.700749 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.700967 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.701054 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.701278 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.701363 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.701599 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.701693 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.701912 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.702004 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.702223 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.702308 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.702532 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.702619 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.702867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.702957 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.703208 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.703293 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.703524 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.703616 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.703832 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.703917 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.704148 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.704235 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.704458 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.704545 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.704770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.704856 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.705082 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.705175 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.705393 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.705480 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.705711 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.705798 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.706023 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.706122 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.706341 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.706434 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.706650 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.706755 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.707002 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.707101 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.707315 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.707400 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.707631 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.707716 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.707937 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.708036 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.708253 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.708339 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.708568 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.708660 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.708895 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.708989 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.709207 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.709301 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.709525 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.709610 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.709836 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.709925 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.710151 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.710238 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.710461 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.710546 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.710799 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.710901 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.711112 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.711257 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.711424 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.711535 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.711741 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.711842 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.712052 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.712139 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.712364 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.712449 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.712672 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.712764 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.712990 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.713074 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.713297 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.713381 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.713616 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.713739 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.713917 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.714010 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.714232 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.714326 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.714547 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.714631 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.714895 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.714982 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.715238 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.715337 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.715631 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.715723 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.715955 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.716042 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.716268 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.716363 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.716580 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.716666 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.716893 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.716978 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.717200 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.717298 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.717506 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.717591 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.717817 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.717910 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.718130 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.718222 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.718439 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.718524 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.718772 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.718863 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.719080 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.719169 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.719395 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.719481 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.719702 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.719787 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.720007 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.720094 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.720312 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.720397 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.720628 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.720711 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.720944 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.721038 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.721251 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.721336 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.721558 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.721656 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.721876 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.721961 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.722176 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.722268 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.722480 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.722574 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.722826 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.722914 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.723138 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.723224 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.723442 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.723540 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.723745 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.723831 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.724048 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.724134 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.724368 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.724467 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.724679 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.724766 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.724979 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.725064 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.725293 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.725379 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.725610 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.725694 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.725920 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.726005 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.726232 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.726325 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.726542 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.726629 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.726877 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.726967 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.727193 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.727279 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.727501 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.727592 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.727810 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.727896 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.728120 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.728207 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.728430 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.728515 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.728738 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.728837 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.729049 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.729134 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.729366 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.729452 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.729671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.729763 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.729983 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.730067 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.730287 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.730379 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.730617 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.730729 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.730953 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.731167 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.731400 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.731487 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.731792 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.731965 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.732105 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.732295 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.732423 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.732608 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.732747 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.732925 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.733243 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.733328 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.733560 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.733647 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.733891 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.733977 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.734218 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.734304 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.734551 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.734644 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.734879 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.734987 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.735190 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.735279 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.735497 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.735595 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.735803 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.735898 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.736115 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.736213 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.736420 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.736507 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.736726 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.736811 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.737030 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.737117 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.737338 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.737425 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.737642 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.737729 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.737946 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.738032 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.738246 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.738331 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.738549 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.738634 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.738878 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.738977 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.739179 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.739264 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.739485 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.739578 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.739784 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.739870 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.740096 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.740181 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.740404 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.740499 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.740714 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.740800 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.741018 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.741110 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.741316 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.741410 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.741649 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.741738 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.741952 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.742037 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.742256 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.742353 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.742566 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.742659 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.742939 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.743038 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.743252 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.743348 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.743557 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.743652 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.743880 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.743965 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.744183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.744270 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.744488 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.744575 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.744790 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.744877 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.745098 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.745185 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.745407 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.745493 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.745709 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.745795 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.746018 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.746106 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.746876 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.746976 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.747191 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.747291 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.747501 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.747595 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.747814 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.747900 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.748123 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.748217 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.748427 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.748513 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.748738 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.748824 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.749044 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.749142 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.749349 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.749436 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.749651 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.749737 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.749961 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.750061 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.750269 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.750354 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.750567 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.750659 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.750897 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.750986 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.751205 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.751299 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.751514 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.751641 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.751813 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.751958 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.752117 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.752252 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.752420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.752507 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.752725 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.752811 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.753032 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.753127 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.753336 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.753420 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.753645 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.753741 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.753949 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.754035 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.754497 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.754599 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.754831 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.754921 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.755140 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.755230 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.755443 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.755541 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.755746 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.755832 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.756051 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.756138 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.756365 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.756460 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.756673 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.756767 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.756973 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.757064 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.757281 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.757375 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.757580 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.757664 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.757884 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.757970 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.758187 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.758274 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.758493 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.758580 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.758819 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.758909 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.759123 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.759220 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.759425 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.759512 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.759727 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.759813 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.760029 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.760169 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.760339 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.760435 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.760644 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.760729 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.760948 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.761035 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.761250 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.761335 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.761551 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.761650 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.762434 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.762561 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.762881 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.763037 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.763290 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.763595 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.763690 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.763909 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.764152 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.764237 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.764526 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.764718 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.764839 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.765152 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.765285 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.765455 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.765772 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.765866 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.766084 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.766170 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.766395 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.766480 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.766753 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.766894 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.767025 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.767220 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.767351 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.767643 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.767770 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.767953 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.768110 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.768274 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.768436 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.768596 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.768769 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.768921 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.769177 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.769270 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.769506 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.769592 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.769815 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.769959 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.770125 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.770435 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.770526 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.770770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.771089 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.771184 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.771402 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.771568 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.771762 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.771904 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.772025 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.772238 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.772333 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.772584 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.772670 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.772921 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.773014 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.773230 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.773318 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.773535 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.773621 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.773859 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.773947 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.774169 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.774472 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.774563 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.774807 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.774910 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.775112 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.775198 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.775420 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.775515 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.775724 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.775810 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.776058 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.776151 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.776381 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.776481 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.776700 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.776792 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.777020 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.777107 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.777325 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.777420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.777755 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.777920 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.778151 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.778350 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.778472 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.778808 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.778956 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.779229 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.779498 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.779585 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.779836 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.780090 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.780177 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.780436 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.780522 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.780739 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.780833 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.781052 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.781139 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.781376 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.781680 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.781775 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.781984 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.782136 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.782287 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.782469 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.782608 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.782818 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.782936 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.783156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.783250 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.783556 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.783641 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.783891 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.783978 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.784242 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.784463 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.784656 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.784967 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.785061 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.785278 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.785602 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.785715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.785923 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.786055 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.786249 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.786389 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.786554 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.786742 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.786892 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.787072 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.787201 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.787394 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.787525 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.787720 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.787849 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.788061 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.788148 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.788383 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.788469 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.788702 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.788788 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.789020 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.789114 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.789356 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.789443 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.789667 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.789752 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.789990 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.790086 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.790403 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.790491 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.790741 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.790828 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.791058 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.791145 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.791378 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.791466 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.791703 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.791813 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.792093 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.792186 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.792461 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.792556 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.792798 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.792931 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.793160 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.793257 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.793478 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.793640 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.793801 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.793973 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.794121 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.794283 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.794454 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.794596 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.794816 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.794922 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.795139 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.795241 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.795468 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.795563 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.795781 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.795867 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.796114 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.796210 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.796416 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.796501 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.796740 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.796834 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.797054 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.797150 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.797381 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.797474 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.797703 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.797790 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.798011 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.798099 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.798333 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.798419 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.798643 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.798742 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.798971 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.799060 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.799276 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.799362 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.799580 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.799667 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.799924 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.800012 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.800228 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.800314 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.800548 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.800643 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.800879 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.800964 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.801201 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.801287 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.801507 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.801601 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.801823 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.801908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.802136 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.802277 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.802447 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.802542 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.802786 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.802878 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.803105 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.803204 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.803406 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.803552 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.803709 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.803797 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.804019 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.804106 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.804325 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.804413 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.804632 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.804717 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.804935 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.805021 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.805243 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.805330 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.805546 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.805632 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.805846 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.806278 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.806420 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.806510 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.806590 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.806667 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.806765 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.806844 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.807076 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.807167 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.807385 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.807472 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.807687 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.807785 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.807988 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.808075 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.808291 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.808410 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.808633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.809272 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.809547 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.809635 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.809907 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.809992 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.810240 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.810335 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.810553 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.810641 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.810892 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.810981 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.811211 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.811315 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.811524 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.811611 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.811838 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.811931 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.812149 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.812235 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.812462 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.812562 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.812772 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.812859 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.813081 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.813167 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.813387 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.813471 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.813695 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.813818 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.814003 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.814136 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.814316 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.814404 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.814627 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.814733 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.814966 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.815056 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.815278 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.815489 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.815578 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.815817 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.815929 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.816133 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.816242 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.816448 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.816585 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.816760 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.816908 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.817073 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.817237 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.817385 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.817573 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.817696 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.817892 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.818006 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.818222 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.818308 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.818547 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.818643 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.818895 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.818983 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.819217 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.819317 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.819538 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.819626 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.819859 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.819946 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.820179 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.820273 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.820499 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.820587 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.820809 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.820901 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.821125 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.821212 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.821440 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.821527 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.821762 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.821850 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.822080 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.822296 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.822385 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.822631 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.822778 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.822981 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.823080 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.823304 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.823395 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.823611 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.823699 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.823925 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.824025 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.824239 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.824358 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.825132 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.825301 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.825447 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.825546 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.825735 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.825846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.826050 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.826147 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.826379 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.826480 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.826733 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.826824 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.827059 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.827146 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.827375 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.827464 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.827687 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.827774 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.828003 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.828089 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.828396 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.828520 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.828719 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.828841 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.829086 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.829182 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.829413 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.829500 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.829729 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.829816 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.830054 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.830149 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.830379 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.830479 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.830714 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.830817 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.831048 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.831147 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.831356 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.831443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.831674 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.831759 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.831980 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.832074 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.832285 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.832375 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.832601 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.832687 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.832909 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.832996 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.833213 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.833344 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.833532 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.833619 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.833841 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.833938 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.834187 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.834369 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.834510 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.834740 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.834846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.835063 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.835158 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.835392 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.835681 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.835768 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.836011 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.836106 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.836316 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.836402 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.836642 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.836742 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.836950 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.837037 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.837256 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.837349 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.837569 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.837669 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.837880 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.837976 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.838187 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.838281 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.838492 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.838591 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.838828 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.838916 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.839142 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.839240 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.839448 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.839550 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.839758 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.839846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.840192 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.840291 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.840448 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.840579 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.840755 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.840843 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.841062 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.841158 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.841369 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.841597 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.841685 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.841952 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.842048 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.842266 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.842365 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.842574 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.842754 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.842905 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.842992 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.843219 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.843319 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.843523 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.843614 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.843834 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.843930 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.844140 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.844230 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.844451 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.844539 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.844757 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.844843 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.845067 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.845155 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.845375 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.845461 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.845694 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.845782 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.846015 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.846116 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.846316 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.846411 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.846624 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.846731 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.846968 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.847058 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.847281 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.847375 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.847590 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.847686 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.847903 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.847989 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.848211 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.848297 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.848525 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.848620 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.848845 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.849070 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.849157 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.849405 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.849500 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.849724 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.849812 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.850049 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.850141 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.850368 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.850455 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.850671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.850815 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.851002 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.851101 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.851310 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.851405 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.851625 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.851710 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.851933 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.852019 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.852245 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.852413 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.852559 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.852647 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.852870 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.853020 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.853180 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.853281 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.853490 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.853585 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.853798 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.853892 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.854107 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.854196 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.854414 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.854543 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.854740 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.854831 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.855054 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.855153 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.855362 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.855456 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.855700 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.855826 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.856042 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.856369 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.856465 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.856714 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.856803 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.857043 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.857160 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.857355 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.857441 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.857666 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.857753 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.857976 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.858064 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.858286 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.858373 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.858595 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.858682 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.858948 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.859038 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.859268 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.859362 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.859586 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.859674 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.859903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.860001 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.860220 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.860313 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.860536 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.860636 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.860852 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.860939 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.861168 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.861254 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.861484 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.861580 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.861799 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.861886 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.862115 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.862202 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.862429 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.862524 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.862761 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.862892 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.863073 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.863160 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.863407 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.863505 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.863729 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.863825 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.864053 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.864141 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.864378 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.864465 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.864686 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.864773 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.864991 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.865085 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.865294 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.865383 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.865605 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.865692 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.865920 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.866006 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.866226 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.866314 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.866529 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.866616 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.866855 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.866958 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.867166 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.867260 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.867469 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.867597 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.867772 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.867916 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.868076 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.868240 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.868379 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.868569 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.868686 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.868888 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.868976 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.869218 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.869304 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.869550 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.869645 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.869850 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.869944 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.870154 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.870241 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.870460 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.870560 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.870792 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.870884 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.871099 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.871694 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.871942 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.872130 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.872246 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.872328 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.872533 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.872621 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.872838 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.872934 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.873171 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.873259 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.873506 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.873594 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.873821 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.873915 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.874133 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.874226 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.874442 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.874528 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.874770 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.874871 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.875084 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.875170 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.875391 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.875477 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.875704 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.875792 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.876013 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.876105 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.876321 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.876422 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.876633 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.876720 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.876942 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.877030 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.877251 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.877346 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.877556 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.877650 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.877864 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.877952 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.878169 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.878264 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.878475 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.878562 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.878821 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.878924 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.879135 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.879232 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.879690 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.879784 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.879997 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.880082 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.880310 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.880398 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.880621 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.880707 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.880933 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.881020 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.881243 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.881331 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.881573 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.881659 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.881888 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.881977 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.882198 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.882288 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.882512 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.882598 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.882846 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.882949 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.883158 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.883246 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.883473 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.883560 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.883788 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.883883 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.884101 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.884187 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.884426 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.884512 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.884737 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.884836 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.885052 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.885145 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.885370 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.885458 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.885690 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.885792 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.886008 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.886094 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.886328 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.886413 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.886663 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.886846 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.887583 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.887725 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.887898 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.888049 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.888205 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.888296 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.888449 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:58:45.888537 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.888842 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.889168 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.889486 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.889823 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.890140 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.890460 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.890812 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.891131 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.891451 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.891776 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.892099 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.892436 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.892771 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.893088 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.893421 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.893756 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.894109 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.894426 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.894805 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.895143 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.895465 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.895785 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.896096 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:58:45.896350 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:58:45.946708 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO dbcounter [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Registered counter for database nova_api May 23 17:58:45.956304 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO dbcounter [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Registered counter for database nova_api May 23 17:58:45.967576 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_db.sqlalchemy.engines [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:45.974400 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writer thread running {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:45.976025 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_db.sqlalchemy.engines [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:45.983089 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writer thread running {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:46.031820 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.context [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13b6f0a-8239-4130-98e7-0248b4fd2533(cell1) {{(pid=103501) load_cells /opt/stack/nova/nova/context.py:464}} May 23 17:58:46.035848 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:58:46.037421 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:58:46.038214 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:58:46.040163 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.context [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13b6f0a-8239-4130-98e7-0248b4fd2533(cell1) {{(pid=103502) load_cells /opt/stack/nova/nova/context.py:464}} May 23 17:58:46.040295 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:58:46.042129 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO dbcounter [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Registered counter for database nova_cell0 May 23 17:58:46.045318 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_concurrency.lockutils [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:58:46.046855 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO dbcounter [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Registered counter for database nova_cell1 May 23 17:58:46.046956 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_concurrency.lockutils [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:58:46.047718 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_concurrency.lockutils [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:58:46.049665 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_concurrency.lockutils [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:58:46.051700 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO dbcounter [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Registered counter for database nova_cell0 May 23 17:58:46.055412 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_db.sqlalchemy.engines [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:46.055916 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO dbcounter [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Registered counter for database nova_cell1 May 23 17:58:46.056294 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_db.sqlalchemy.engines [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:46.062075 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writer thread running {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:46.067329 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writer thread running {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:46.067484 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_db.sqlalchemy.engines [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:46.068558 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_db.sqlalchemy.engines [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:46.075297 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writer thread running {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:46.076548 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writer thread running {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:46.209841 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO dbcounter [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Registered counter for database nova_cell0 May 23 17:58:46.218576 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_db.sqlalchemy.engines [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:46.222906 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writer thread running {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:46.224323 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO dbcounter [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Registered counter for database nova_cell0 May 23 17:58:46.233425 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG oslo_db.sqlalchemy.engines [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:58:46.237744 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writer thread running {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:58:46.559375 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: WARNING keystonemiddleware.auth_token [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:58:46.566727 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: WARNING keystonemiddleware.auth_token [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:58:46.576778 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: WARNING keystonemiddleware.auth_token [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:58:46.583911 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: WARNING keystonemiddleware.auth_token [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:58:46.908231 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: WARNING keystonemiddleware.auth_token [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:58:46.914125 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: WARNING keystonemiddleware.auth_token [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:58:46.920222 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56273159c9c0 pid: 103501 (default app) May 23 17:58:46.922268 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:58:46.923475 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 May 23 17:58:46.923885 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Mon May 23 17:58:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:58:46.935977 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: WARNING keystonemiddleware.auth_token [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:58:46.941885 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: WARNING keystonemiddleware.auth_token [None req-519c1c73-1bc9-4ac5-9b32-c230c80e7496 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:58:46.947109 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56273159c9c0 pid: 103502 (default app) May 23 18:00:05.196507 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:05.197606 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 23 18:00:05.199076 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:05.209990 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writing DB stats nova_api:SELECT=3 {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:05.211194 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writing DB stats nova_cell1:SELECT=3 {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:05.212311 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writing DB stats nova_cell0:SELECT=3 {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:05.214278 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:05.657876 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-4bb9b093-6482-41c9-a1cc-9a1aadd6f43d admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:05.693928 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-4bb9b093-6482-41c9-a1cc-9a1aadd6f43d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.489019 May 23 18:00:05.695233 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 18:00:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:07.966434 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:07.967570 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-40c36d38-0818-4621-a203-3b9f95e2a0c7 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 23 18:00:07.968213 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:08.032447 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-b390dfaa-0e93-4e89-a767-6b4c4755cfd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "disk": 1, "vcpus": 1}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:08.069582 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:00:08.069582 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: warnings.warn(msg) May 23 18:00:08.100374 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-b390dfaa-0e93-4e89-a767-6b4c4755cfd4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.126026 May 23 18:00:08.101518 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:00:08.115380 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_api:SELECT=3 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:08.116641 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_cell1:SELECT=3 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:08.117696 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_cell0:SELECT=3 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:08.118547 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:08.336317 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-c2429dfd-1364-4d0e-bf04-d03226dd33cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:08.339413 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:00:08.339413 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: warnings.warn(msg) May 23 18:00:08.405222 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-c2429dfd-1364-4d0e-bf04-d03226dd33cb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294980 May 23 18:00:08.406046 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 18:00:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:10.684110 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-b390dfaa-0e93-4e89-a767-6b4c4755cfd4 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:10.685173 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-b390dfaa-0e93-4e89-a767-6b4c4755cfd4 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 23 18:00:10.685604 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:10.791571 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-772e0266-2c1b-4613-82bf-1ec8ad0deaf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "swap": 0}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:10.809154 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:00:10.809154 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: warnings.warn(msg) May 23 18:00:10.828198 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-772e0266-2c1b-4613-82bf-1ec8ad0deaf5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136422 May 23 18:00:10.828759 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:00:10.840992 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-30929867-fbed-4d86-9b40-5c6d4b5b5dcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:10.842480 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:00:10.842480 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: warnings.warn(msg) May 23 18:00:10.873293 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-30929867-fbed-4d86-9b40-5c6d4b5b5dcf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036576 May 23 18:00:10.873868 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 18:00:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:13.165462 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-772e0266-2c1b-4613-82bf-1ec8ad0deaf5 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:13.167069 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-772e0266-2c1b-4613-82bf-1ec8ad0deaf5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 May 23 18:00:13.167465 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:13.227156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-eaf1ba84-a8bb-4e19-9bd2-cfe91c29f113 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:13.253842 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-eaf1ba84-a8bb-4e19-9bd2-cfe91c29f113 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080512 May 23 18:00:13.254413 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:00:13.268095 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-61d52e4f-31c7-4385-bbe5-ebefbbf3f0dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:13.299203 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-61d52e4f-31c7-4385-bbe5-ebefbbf3f0dc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035497 May 23 18:00:13.300147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 18:00:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:15.709762 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-eaf1ba84-a8bb-4e19-9bd2-cfe91c29f113 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:15.710878 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-eaf1ba84-a8bb-4e19-9bd2-cfe91c29f113 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 23 18:00:15.711527 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:15.776354 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-eab063e7-81ae-4187-86c0-8db9cb88a6bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:15.795844 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-eab063e7-81ae-4187-86c0-8db9cb88a6bb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077674 May 23 18:00:15.796422 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:00:15.809120 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-833fdc5f-15da-4780-a8cb-43f8d8daa65c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:15.834914 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-833fdc5f-15da-4780-a8cb-43f8d8daa65c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030043 May 23 18:00:15.835520 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 18:00:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:18.276869 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-eab063e7-81ae-4187-86c0-8db9cb88a6bb admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:18.277770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-eab063e7-81ae-4187-86c0-8db9cb88a6bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002678 May 23 18:00:18.278169 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:18.345385 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-7d5041b9-0529-42b1-87d3-f084ede8b840 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:18.365264 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-7d5041b9-0529-42b1-87d3-f084ede8b840 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081090 May 23 18:00:18.366095 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:00:18.377614 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-8f12e8fe-2337-4137-b98d-b933e918a2d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:18.402477 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-8f12e8fe-2337-4137-b98d-b933e918a2d4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028273 May 23 18:00:18.403229 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 18:00:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:20.894397 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-7d5041b9-0529-42b1-87d3-f084ede8b840 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:20.895607 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-7d5041b9-0529-42b1-87d3-f084ede8b840 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 May 23 18:00:20.896024 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:20.961843 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-ebe5d9e5-492d-4172-bcd4-70a1e5bb9314 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:20.986353 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-ebe5d9e5-492d-4172-bcd4-70a1e5bb9314 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082951 May 23 18:00:20.987119 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 18:00:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:00:23.248332 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-7d5041b9-0529-42b1-87d3-f084ede8b840 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:23.249431 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-7d5041b9-0529-42b1-87d3-f084ede8b840 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 23 18:00:23.249825 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:00:23.309064 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-408369c2-36f6-4b2c-b575-caa3cf2ad867 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:23.327871 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-408369c2-36f6-4b2c-b575-caa3cf2ad867 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072328 May 23 18:00:23.328421 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:00:23.340965 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-e8cee80b-dace-4d08-aa83-a5209d9626a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:23.371623 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-e8cee80b-dace-4d08-aa83-a5209d9626a8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035152 May 23 18:00:23.372383 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 18:00:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:00:25.670180 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-408369c2-36f6-4b2c-b575-caa3cf2ad867 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:25.671190 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-408369c2-36f6-4b2c-b575-caa3cf2ad867 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 23 18:00:25.671588 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:00:25.735168 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-862aead7-0ef5-4917-88b3-a12436d05213 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "ram": 2048, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:25.752676 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-862aead7-0ef5-4917-88b3-a12436d05213 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073041 May 23 18:00:25.753232 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:00:25.765889 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-3899eafd-a21f-433a-a6de-f385d725d661 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:25.788987 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-3899eafd-a21f-433a-a6de-f385d725d661 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026750 May 23 18:00:25.789558 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 18:00:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:28.250638 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-862aead7-0ef5-4917-88b3-a12436d05213 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:28.251722 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-862aead7-0ef5-4917-88b3-a12436d05213 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 23 18:00:28.252132 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:28.310888 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-8eac584d-3ad0-4851-a1a1-171df6c7ed5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "disk": 40}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:28.331878 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-8eac584d-3ad0-4851-a1a1-171df6c7ed5d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073598 May 23 18:00:28.337632 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:00:28.345119 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-0c514c8b-3ac5-4dd6-b98f-a0a71563b710 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:28.367304 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-0c514c8b-3ac5-4dd6-b98f-a0a71563b710 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025961 May 23 18:00:28.367877 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 18:00:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:30.631765 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-8eac584d-3ad0-4851-a1a1-171df6c7ed5d admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:30.632798 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-8eac584d-3ad0-4851-a1a1-171df6c7ed5d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 May 23 18:00:30.633156 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:30.695676 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-6deffadf-40ad-4387-b384-1d7b99e8312d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:30.715584 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-6deffadf-40ad-4387-b384-1d7b99e8312d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075963 May 23 18:00:30.716227 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:00:30.727820 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-151f1b1d-0fe2-4384-82fe-d528117adcf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:30.751869 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-151f1b1d-0fe2-4384-82fe-d528117adcf3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027642 May 23 18:00:30.752463 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 18:00:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:00:33.101736 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-6deffadf-40ad-4387-b384-1d7b99e8312d admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:33.103426 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-6deffadf-40ad-4387-b384-1d7b99e8312d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 May 23 18:00:33.110881 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:33 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:33.169525 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-b7e511a5-c803-4239-aafd-41ff3c704d92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "id": "5", "vcpus": 8}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:33.191067 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-b7e511a5-c803-4239-aafd-41ff3c704d92 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078999 May 23 18:00:33.191879 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 18:00:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:00:33.203893 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-75042088-3ff6-40a9-b2a5-41227ec084ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:00:33.227981 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-75042088-3ff6-40a9-b2a5-41227ec084ff admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027972 May 23 18:00:33.229379 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 18:00:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:00:57.568607 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-b7e511a5-c803-4239-aafd-41ff3c704d92 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:57.569624 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-b7e511a5-c803-4239-aafd-41ff3c704d92 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 23 18:00:57.570025 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:00:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:57.580363 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:57.629057 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-9f72c8cc-44d5-4473-9dc3-e9730276fe31 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:57.646132 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-9f72c8cc-44d5-4473-9dc3-e9730276fe31 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070304 May 23 18:00:57.646656 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 18:00:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:00:58.658718 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-b7e511a5-c803-4239-aafd-41ff3c704d92 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:58.659719 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-b7e511a5-c803-4239-aafd-41ff3c704d92 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 18:00:58.660112 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:00:58.883076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-ca995050-e4dd-47d1-9976-f82d9a69c98a admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:58.888802 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.wsgi [None req-ca995050-e4dd-47d1-9976-f82d9a69c98a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-ca995050-e4dd-47d1-9976-f82d9a69c98a admin admin] Request method failure captured: May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Accept: application/json May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Accept-Encoding: gzip, deflate May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Connection: keep-alive May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Content-Length: 0 May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Host: 10.222.0.30 May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Openstack-Api-Version: compute 2.90 May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Openstack-System-Scope: None May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: User-Agent: python-novaclient May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Auth-Token: gAAAAABii8va0bpZw0HibIsc833QpiG6qjO0vWXiSQ2gZDjwH8uXbwwH-aFrZq4zSqqlNR87nISwktIeTGSro0yoZ-u0XSTNkN2eIc28Nc7RNEXsVHWX2UzDm783JnQjq39celKKjA_2MHRpcBAhUVFHt2r0FJIV10CvuWITGUpMzSHLXShP40A May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Domain-Id: None May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Domain-Name: None May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Identity-Status: Confirmed May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Is-Admin-Project: True May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Openstack-Nova-Api-Version: 2.90 May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Domain-Id: default May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Domain-Name: Default May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Name: admin May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Role: admin,member,reader May 23 18:00:58.892100 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Roles: admin,member,reader May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant: admin May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant-Name: admin May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User: admin May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Domain-Id: default May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Domain-Name: Default May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Id: 1f5dea6992a4447085d8377492272c61 May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Name: admin May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: method: > May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: exception: Flavor 42 could not be found. May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: action_args: {'id': '42'} May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:00:58.893765 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:00:58.894867 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:00:58.896076 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-ca995050-e4dd-47d1-9976-f82d9a69c98a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:00:58.897118 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-ca995050-e4dd-47d1-9976-f82d9a69c98a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062706 May 23 18:00:58.897118 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 18:00:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 18:00:58.903263 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-52d85977-2f30-4533-a6ba-15e546675d20 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:58.906190 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:58.926614 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-52d85977-2f30-4533-a6ba-15e546675d20 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026919 May 23 18:00:58.927187 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 18:00:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:00:58.937499 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-388d1d41-8e77-42bd-8971-e0bee2bd8695 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:58.962555 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-388d1d41-8e77-42bd-8971-e0bee2bd8695 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028694 May 23 18:00:58.963121 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 18:00:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:00:58.972309 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-58ec6d8b-dbb5-46b6-8539-3e9eacddd007 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:58.978983 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.wsgi [None req-58ec6d8b-dbb5-46b6-8539-3e9eacddd007 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-58ec6d8b-dbb5-46b6-8539-3e9eacddd007 admin admin] Request method failure captured: May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Accept: application/json May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Accept-Encoding: gzip, deflate May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Connection: keep-alive May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Content-Length: 0 May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Host: 10.222.0.30 May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Openstack-Api-Version: compute 2.90 May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Openstack-System-Scope: None May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: User-Agent: python-novaclient May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Auth-Token: gAAAAABii8va0bpZw0HibIsc833QpiG6qjO0vWXiSQ2gZDjwH8uXbwwH-aFrZq4zSqqlNR87nISwktIeTGSro0yoZ-u0XSTNkN2eIc28Nc7RNEXsVHWX2UzDm783JnQjq39celKKjA_2MHRpcBAhUVFHt2r0FJIV10CvuWITGUpMzSHLXShP40A May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Domain-Id: None May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Domain-Name: None May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Identity-Status: Confirmed May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Is-Admin-Project: True May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Openstack-Nova-Api-Version: 2.90 May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Domain-Id: default May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Domain-Name: Default May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Name: admin May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Role: admin,member,reader May 23 18:00:58.982206 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Roles: admin,member,reader May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant: admin May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant-Name: admin May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User: admin May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Domain-Id: default May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Domain-Name: Default May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Id: 1f5dea6992a4447085d8377492272c61 May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Name: admin May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: method: > May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: exception: Flavor 42 could not be found. May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: action_args: {'id': '42'} May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:00:58.983770 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:00:58.984633 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:00:58.985764 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-58ec6d8b-dbb5-46b6-8539-3e9eacddd007 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:00:58.987015 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-58ec6d8b-dbb5-46b6-8539-3e9eacddd007 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014848 May 23 18:00:58.987015 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 18:00:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 18:00:59.858160 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-388d1d41-8e77-42bd-8971-e0bee2bd8695 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:00:59.859217 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-388d1d41-8e77-42bd-8971-e0bee2bd8695 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 23 18:00:59.859613 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:01:00.049017 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-884269d8-7410-4490-a361-c16c879e211c admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:00.057191 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.wsgi [None req-884269d8-7410-4490-a361-c16c879e211c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-884269d8-7410-4490-a361-c16c879e211c admin admin] Request method failure captured: May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Accept: application/json May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Accept-Encoding: gzip, deflate May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Connection: keep-alive May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Content-Length: 0 May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Host: 10.222.0.30 May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Openstack-Api-Version: compute 2.90 May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Openstack-System-Scope: None May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: User-Agent: python-novaclient May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Auth-Token: gAAAAABii8vbS3kAPySvCYA-0eo5qzvGP7w1HUNQP9LcEr6_DFtGPVJrra-yUWqVI7dav4CiX4P5M2s2HDy3dUtw7HYwHUHDi_fE7EA2CCppCqU_nAjO_IzPIj6cxHmYaB4prkHKvNTs2q21YJ7cjfaTxy9_H9JyBiGPgxNLDj4vC2i_0r6zyzQ May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Domain-Id: None May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Domain-Name: None May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Identity-Status: Confirmed May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Is-Admin-Project: True May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Openstack-Nova-Api-Version: 2.90 May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Domain-Id: default May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Domain-Name: Default May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Name: admin May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Role: admin,member,reader May 23 18:01:00.058732 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Roles: admin,member,reader May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant: admin May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant-Name: admin May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User: admin May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Domain-Id: default May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Domain-Name: Default May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Id: 1f5dea6992a4447085d8377492272c61 May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Name: admin May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: method: > May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: exception: Flavor 84 could not be found. May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: action_args: {'id': '84'} May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:01:00.060247 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:00.061147 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:00.062183 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-884269d8-7410-4490-a361-c16c879e211c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:01:00.063487 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-884269d8-7410-4490-a361-c16c879e211c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063489 May 23 18:01:00.063487 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 18:00:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 18:01:00.070201 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-4b2a1b34-0c4c-4ac6-bdac-9b3b776a8d27 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:00.085961 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-4b2a1b34-0c4c-4ac6-bdac-9b3b776a8d27 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019353 May 23 18:01:00.086521 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 18:01:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:01:00.096584 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-3d2ad8cb-6cbc-44ec-868b-2a09a5cd192b admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:00.111130 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-3d2ad8cb-6cbc-44ec-868b-2a09a5cd192b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018181 May 23 18:01:00.111673 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 18:01:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:01:00.121253 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-2bbf1943-565f-4774-88e8-79007a5f8cf3 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:00.126619 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.wsgi [None req-2bbf1943-565f-4774-88e8-79007a5f8cf3 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-2bbf1943-565f-4774-88e8-79007a5f8cf3 admin admin] Request method failure captured: May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Accept: application/json May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Accept-Encoding: gzip, deflate May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Connection: keep-alive May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Content-Length: 0 May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Host: 10.222.0.30 May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Openstack-Api-Version: compute 2.90 May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Openstack-System-Scope: None May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: User-Agent: python-novaclient May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Auth-Token: gAAAAABii8vbS3kAPySvCYA-0eo5qzvGP7w1HUNQP9LcEr6_DFtGPVJrra-yUWqVI7dav4CiX4P5M2s2HDy3dUtw7HYwHUHDi_fE7EA2CCppCqU_nAjO_IzPIj6cxHmYaB4prkHKvNTs2q21YJ7cjfaTxy9_H9JyBiGPgxNLDj4vC2i_0r6zyzQ May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Domain-Id: None May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Domain-Name: None May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Identity-Status: Confirmed May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Is-Admin-Project: True May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Openstack-Nova-Api-Version: 2.90 May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Domain-Id: default May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Domain-Name: Default May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Name: admin May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Role: admin,member,reader May 23 18:01:00.128156 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Roles: admin,member,reader May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant: admin May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant-Name: admin May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User: admin May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Domain-Id: default May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Domain-Name: Default May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Id: 1f5dea6992a4447085d8377492272c61 May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Name: admin May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: method: > May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: exception: Flavor 84 could not be found. May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: action_args: {'id': '84'} May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:01:00.129715 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:00.130840 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:00.132420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-2bbf1943-565f-4774-88e8-79007a5f8cf3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:01:00.133739 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-2bbf1943-565f-4774-88e8-79007a5f8cf3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012203 May 23 18:01:00.133739 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 18:01:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 18:01:00.999866 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-3d2ad8cb-6cbc-44ec-868b-2a09a5cd192b admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:01.000891 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-3d2ad8cb-6cbc-44ec-868b-2a09a5cd192b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 23 18:01:01.001281 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:01:01.190561 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-938c1039-4ed8-4dd4-8c33-ee6738603b80 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:01.196420 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.wsgi [None req-938c1039-4ed8-4dd4-8c33-ee6738603b80 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-938c1039-4ed8-4dd4-8c33-ee6738603b80 admin admin] Request method failure captured: May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Accept: application/json May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Accept-Encoding: gzip, deflate May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Connection: keep-alive May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Content-Length: 0 May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Host: 10.222.0.30 May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Openstack-Api-Version: compute 2.90 May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Openstack-System-Scope: None May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: User-Agent: python-novaclient May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Auth-Token: gAAAAABii8vcajkEJMRXvy7MdL4BWb-jtOUmrYWBnXfIYhWagX06QG8BlxXKdDfbAw0ducqCkTSU8LXT080QGwJZcJIO6DMVRhWlNdbcb9CNK_Y-PBrld_ZcDdLnI_CI6v6sPLxBWH9tsPrMMW8aRijN11QECMm-NfPNOhDJiQHBVbI3_A8Ts6A May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Domain-Id: None May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Domain-Name: None May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Identity-Status: Confirmed May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Is-Admin-Project: True May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Openstack-Nova-Api-Version: 2.90 May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Domain-Id: default May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Domain-Name: Default May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Project-Name: admin May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Role: admin,member,reader May 23 18:01:01.198443 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Roles: admin,member,reader May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant: admin May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-Tenant-Name: admin May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User: admin May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Domain-Id: default May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Domain-Name: Default May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Id: 1f5dea6992a4447085d8377492272c61 May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: X-User-Name: admin May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: method: > May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: exception: Flavor 451 could not be found. May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: action_args: {'id': '451'} May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:01:01.199963 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:01.200846 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: ERROR nova.api.openstack.wsgi May 23 18:01:01.201903 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-938c1039-4ed8-4dd4-8c33-ee6738603b80 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:01:01.203039 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-938c1039-4ed8-4dd4-8c33-ee6738603b80 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061473 May 23 18:01:01.203039 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 18:01:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 18:01:01.209613 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-386f557f-030c-40cd-92d7-8f2d30011ad3 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:01.225007 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-386f557f-030c-40cd-92d7-8f2d30011ad3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018960 May 23 18:01:01.225535 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 18:01:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:01:01.235546 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:01.249735 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017682 May 23 18:01:01.250271 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 18:01:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:01:01.259793 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-eaafdbbf-12a4-45b0-9a6f-a5b7ba678743 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:01.265148 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.wsgi [None req-eaafdbbf-12a4-45b0-9a6f-a5b7ba678743 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-eaafdbbf-12a4-45b0-9a6f-a5b7ba678743 admin admin] Request method failure captured: May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Accept: application/json May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Accept-Encoding: gzip, deflate May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Connection: keep-alive May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Content-Length: 0 May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Host: 10.222.0.30 May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Openstack-Api-Version: compute 2.90 May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Openstack-System-Scope: None May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: User-Agent: python-novaclient May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Auth-Token: gAAAAABii8vcajkEJMRXvy7MdL4BWb-jtOUmrYWBnXfIYhWagX06QG8BlxXKdDfbAw0ducqCkTSU8LXT080QGwJZcJIO6DMVRhWlNdbcb9CNK_Y-PBrld_ZcDdLnI_CI6v6sPLxBWH9tsPrMMW8aRijN11QECMm-NfPNOhDJiQHBVbI3_A8Ts6A May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Domain-Id: None May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Domain-Name: None May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Identity-Status: Confirmed May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Is-Admin-Project: True May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Openstack-Nova-Api-Version: 2.90 May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Domain-Id: default May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Domain-Name: Default May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Project-Name: admin May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Role: admin,member,reader May 23 18:01:01.266671 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Roles: admin,member,reader May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_883a3e766acb4bf0a201fc243774389f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/883a3e766acb4bf0a201fc243774389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant: admin May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant-Id: 883a3e766acb4bf0a201fc243774389f May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-Tenant-Name: admin May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User: admin May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Domain-Id: default May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Domain-Name: Default May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Id: 1f5dea6992a4447085d8377492272c61 May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: X-User-Name: admin May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: method: > May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: exception: Flavor 451 could not be found. May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: action_args: {'id': '451'} May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:01:01.268432 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:01.269456 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: ERROR nova.api.openstack.wsgi May 23 18:01:01.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-eaafdbbf-12a4-45b0-9a6f-a5b7ba678743 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:01:01.272195 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-eaafdbbf-12a4-45b0-9a6f-a5b7ba678743 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012244 May 23 18:01:01.272195 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 18:01:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 18:01:02.139658 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:02.140666 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 18:01:02.141070 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:01:02.331219 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-b3fd08d0-4e72-43e6-adc9-80f3f7bcf5b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:01:02.348378 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-b3fd08d0-4e72-43e6-adc9-80f3f7bcf5b7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069538 May 23 18:01:02.348858 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 18:01:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:01:03.235277 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:03.236387 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 May 23 18:01:03.236789 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:01:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:01:03.425534 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-d1e62463-8bad-43a0-8084-45752768b920 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:01:03.442645 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-d1e62463-8bad-43a0-8084-45752768b920 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068519 May 23 18:01:03.443233 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 18:01:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:01:04.318751 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:04.319792 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 23 18:01:04.320194 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:01:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:01:04.510070 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-2e0876f3-2ef0-443f-aab4-7bbe8dedc9d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:01:04.529812 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-2e0876f3-2ef0-443f-aab4-7bbe8dedc9d9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071912 May 23 18:01:04.530311 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 18:01:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:01:05.394630 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:05.395670 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 23 18:01:05.396084 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:01:05.586985 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-25ca91e8-404d-493c-97c4-f8fbbc3cfb91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:01:05.605387 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-25ca91e8-404d-493c-97c4-f8fbbc3cfb91 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071173 May 23 18:01:05.605868 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 18:01:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:01:06.468279 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:06.469278 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 23 18:01:06.469680 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:01:06.657041 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-aeee73b1-2aca-43e5-aa14-acad5db4ca1d admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:01:06.676046 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-aeee73b1-2aca-43e5-aa14-acad5db4ca1d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071572 May 23 18:01:06.676593 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Mon May 23 18:01:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:02:08.652584 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:02:08.653586 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-c87dd347-d51d-426e-b36d-8c7421f082b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 23 18:02:08.653993 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 18:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:02:08.661572 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:02:08.713710 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-821dd9d3-ddec-4832-a802-e560f6d17151 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:02:08.732875 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-821dd9d3-ddec-4832-a802-e560f6d17151 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072825 May 23 18:02:08.733420 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 18:02:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:02:08.754083 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG dbcounter [-] [103502] Writing DB stats nova_api:SELECT=14 {{(pid=103502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:02:08.758450 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-8170a7fd-c8c4-4583-9f1a-00d7f1a9e36f admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:02:08.766359 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-8170a7fd-c8c4-4583-9f1a-00d7f1a9e36f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013685 May 23 18:02:08.766925 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Mon May 23 18:02:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:02:08.778974 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-2539dce4-970c-4de2-870a-481ea15d9814 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:02:08.786389 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-2539dce4-970c-4de2-870a-481ea15d9814 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011074 May 23 18:02:08.786934 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Mon May 23 18:02:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:02:08.797835 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:02:08.805299 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010925 May 23 18:02:08.805805 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Mon May 23 18:02:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:02:08.818013 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-61d16e7b-1306-4f1a-8e36-e0f80836ca94 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:02:08.826187 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-61d16e7b-1306-4f1a-8e36-e0f80836ca94 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011729 May 23 18:02:08.826724 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Mon May 23 18:02:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:05:41.108014 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:41.109084 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 23 18:05:41.109492 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:05:41.265037 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_api:SELECT=6 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:05:41.377837 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-75557219-d830-45ff-a2d4-11af0ff57beb admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:41.379171 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:05:41.379171 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: warnings.warn(msg) May 23 18:05:41.380385 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-75557219-d830-45ff-a2d4-11af0ff57beb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:41.380826 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-75557219-d830-45ff-a2d4-11af0ff57beb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:41.381616 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-75557219-d830-45ff-a2d4-11af0ff57beb admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:41.382046 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-75557219-d830-45ff-a2d4-11af0ff57beb admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:41.416751 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-75557219-d830-45ff-a2d4-11af0ff57beb admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153105 May 23 18:05:41.417332 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 18:05:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:05:42.316170 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:42.317264 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 23 18:05:42.317678 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:05:42.511736 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-d57a227d-9100-489f-98e9-55a9e56e914c admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:42.512954 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:05:42.512954 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: warnings.warn(msg) May 23 18:05:42.514146 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-d57a227d-9100-489f-98e9-55a9e56e914c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:42.514593 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-d57a227d-9100-489f-98e9-55a9e56e914c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:42.515420 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-d57a227d-9100-489f-98e9-55a9e56e914c admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:42.515853 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-d57a227d-9100-489f-98e9-55a9e56e914c admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:42.536521 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-d57a227d-9100-489f-98e9-55a9e56e914c admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077083 May 23 18:05:42.537293 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 18:05:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:05:53.874328 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:53.875372 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 23 18:05:53.875775 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:05:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:05:54.020179 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_cell0:SELECT=4 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:05:54.020932 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_cell1:SELECT=4 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:05:54.021553 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG dbcounter [-] [103501] Writing DB stats nova_api:SELECT=8 {{(pid=103501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:05:54.069713 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-85c2449e-d6fe-4a57-bd82-a82b93beb6a4 admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:54.070926 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:05:54.070926 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: warnings.warn(msg) May 23 18:05:54.072131 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-85c2449e-d6fe-4a57-bd82-a82b93beb6a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:54.072573 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-85c2449e-d6fe-4a57-bd82-a82b93beb6a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:54.073368 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-85c2449e-d6fe-4a57-bd82-a82b93beb6a4 admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:54.073827 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-85c2449e-d6fe-4a57-bd82-a82b93beb6a4 admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:54.100216 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-85c2449e-d6fe-4a57-bd82-a82b93beb6a4 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084291 May 23 18:05:54.100707 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 18:05:54 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:05:55.002999 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: DEBUG nova.api.openstack.wsgi [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] Calling method '>' {{(pid=103502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:55.005404 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: INFO nova.api.openstack.requestlog [None req-da34b2e1-3935-445b-b7a3-cd806696dfd9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002854 May 23 18:05:55.005811 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: [pid: 103502|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 18:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:05:55.198957 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG nova.api.openstack.wsgi [None req-566b0051-edaa-47d8-8d3c-c273f88d7d8c admin admin] Calling method '>' {{(pid=103501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:05:55.200119 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:05:55.200119 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: warnings.warn(msg) May 23 18:05:55.201327 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-566b0051-edaa-47d8-8d3c-c273f88d7d8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:55.201793 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-566b0051-edaa-47d8-8d3c-c273f88d7d8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:55.202574 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-566b0051-edaa-47d8-8d3c-c273f88d7d8c admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:05:55.203048 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: DEBUG oslo_concurrency.lockutils [None req-566b0051-edaa-47d8-8d3c-c273f88d7d8c admin admin] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:05:55.224812 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: INFO nova.api.openstack.requestlog [None req-566b0051-edaa-47d8-8d3c-c273f88d7d8c admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077242 May 23 18:05:55.225376 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: [pid: 103501|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 18:05:55 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:06:51.554962 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: Mon May 23 18:06:51 2022 - graceful shutdown triggered... May 23 18:06:51.555196 dv-cinder-750782-23-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 18:06:51.555947 dv-cinder-750782-23-iscsi devstack@n-api.service[103502]: Gracefully killing worker 2 (pid: 103502)... May 23 18:06:51.556310 dv-cinder-750782-23-iscsi devstack@n-api.service[103501]: Gracefully killing worker 1 (pid: 103501)... May 23 18:06:52.556085 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: worker 1 buried after 1 seconds May 23 18:06:52.556085 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: worker 2 buried after 1 seconds May 23 18:06:52.556633 dv-cinder-750782-23-iscsi devstack@n-api.service[103500]: goodbye to uWSGI. May 23 18:06:52.557676 dv-cinder-750782-23-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 18:06:52.558246 dv-cinder-750782-23-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 18:06:52.560994 dv-cinder-750782-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 18:06:52.578508 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 18:06:52 2022] *** May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: nodename: dv-cinder-750782-23-iscsi May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: machine: x86_64 May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: clock source: unix May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: pcre jit disabled May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: detected number of CPU cores: 4 May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: current working directory: / May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: detected binary path: /usr/bin/uwsgi-core May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: your processes number limit is 47680 May 23 18:06:52.599206 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: your memory page size is 4096 bytes May 23 18:06:52.600152 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: detected max file descriptor number: 2048 May 23 18:06:52.600152 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: lock engine: pthread robust mutexes May 23 18:06:52.600152 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: thunder lock: enabled May 23 18:06:52.600152 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 18:06:52.600152 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 18:06:52.649299 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: Python main interpreter initialized at 0x560c096b49c0 May 23 18:06:52.649299 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: python threads support enabled May 23 18:06:52.649299 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: your server socket listen backlog is limited to 100 connections May 23 18:06:52.649299 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: your mercy for graceful operations on workers is 90 seconds May 23 18:06:52.649762 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: mapped 403077 bytes (393 KB) for 2 cores May 23 18:06:52.649762 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: *** Operational MODE: preforking *** May 23 18:06:52.650018 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: *** uWSGI is running in multiple interpreter mode *** May 23 18:06:52.650018 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: spawned uWSGI master process (pid: 117913) May 23 18:06:52.650226 dv-cinder-750782-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 18:06:52.652629 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: spawned uWSGI worker 1 (pid: 117928, cores: 1) May 23 18:06:52.652629 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: spawned uWSGI worker 2 (pid: 117929, cores: 1) May 23 18:06:52.653545 dv-cinder-750782-23-iscsi devstack@n-api.service[117913]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 18:06:53.843271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 18:06:53.844022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 18:06:54.628606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 18:06:54.628606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: from cryptography.utils import int_from_bytes May 23 18:06:54.629070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 18:06:54.629070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: from cryptography.utils import int_from_bytes May 23 18:06:54.633277 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 18:06:54.633277 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: from cryptography.utils import int_from_bytes May 23 18:06:54.633873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 18:06:54.633873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: from cryptography.utils import int_from_bytes May 23 18:06:57.065904 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 18:06:57.067373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 18:06:57.067373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 18:06:57.067797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 18:06:57.068086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 18:06:57.068487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.068822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.069160 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.069475 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.069817 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.070136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.070464 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.070817 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.071152 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.071417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.071737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.072065 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-23-iscsi {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.072392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.072704 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.073019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.073337 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.073643 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.073968 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.074274 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.074809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.076250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.076250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.076250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.076250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.076589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.076811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.077130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.077420 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.077745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.078052 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.078460 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-23-iscsi {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.078804 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.079130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.079448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.079858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.080183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.080493 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.080799 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.081122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.081427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.081755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.082086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.082986 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.083809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.083809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.084131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.084280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.084467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.084781 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.085093 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.085341 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.085649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.085976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.086297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.086621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.086897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.087149 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.087471 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.087796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.088103 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.088406 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.088712 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.089022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.089335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.089641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.089949 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.090253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.090575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.090923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.091223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.091532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.091849 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.091958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 18:06:57.092362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 18:06:57.092450 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.092524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.092743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 18:06:57.092900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.093110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 18:06:57.093266 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.093414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 18:06:57.093567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.093718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.093874 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.094038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.094181 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.094321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.094469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.094611 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.094877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.095050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.095220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.095389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.095538 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.095717 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.095872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.096020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.096171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.096312 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.096459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.096614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.096783 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.096938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.097080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.097228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.097379 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-750782-23-iscsi {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.097533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.097683 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.098430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.098590 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.098780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.098931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.099088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.099231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.099378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.099519 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.099680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.099840 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.099991 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.100192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.100362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.100362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.100667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.100839 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.100991 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.101142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.101291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.102724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.102867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.102960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103036 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103108 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103180 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103712 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103808 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.103992 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104177 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104177 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104347 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-750782-23-iscsi {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104613 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104704 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104793 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.104978 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.105105 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.105279 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.105428 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.105572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.105722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.105889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.106044 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.106188 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.106342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.106490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.106632 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.106817 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.106962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.107102 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.107275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.108330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.108489 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.108648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.108803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.108944 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.109091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.109232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.109372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.109525 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.109677 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.109819 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.109966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.110114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.110270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.110495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.110662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.110847 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.111063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.111219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.111371 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.111550 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.112351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.112504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.112663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.112806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.112956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.113098 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.113243 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.113442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.113442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.114339 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.114500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.114645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.114645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.114985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.115129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.115280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.115432 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.115584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.115745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.115896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.116037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.116191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.116341 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.116482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.116629 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.116778 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.116929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.117078 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.117225 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.117372 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.117514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.117664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.117815 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.117956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.118097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.118237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.118376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.118523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.118673 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.118898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.119042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.119042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.119326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.119326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.119627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.119777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.119925 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.119925 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.120205 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.120205 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.120484 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.120631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.120772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.120772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.121054 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.121054 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.121347 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.121495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.121644 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.121813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.122625 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.122804 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.122960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.123112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.123254 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.123394 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.123542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.123693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.123852 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.124018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.124173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.124321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.126890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.127060 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.127209 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.127355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.127515 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.128133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.128371 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.128528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.128679 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.128829 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.128990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.129895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.130055 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.130200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.130445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.130587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.130790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.130938 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.131093 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.131237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.131377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.131518 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.131658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.131824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.131995 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.132835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.132981 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.133160 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.133315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.133723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.133866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.134006 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.134147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.134147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.134415 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.134582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.134748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.134944 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.135097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.135239 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.135387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.135537 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.135680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.135821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.135974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.136123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.136273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.136428 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.136587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.136587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.136858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.137047 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.137194 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.137335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.137475 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.137622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.137772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.137925 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.138074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.138223 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.138371 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.138523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.138671 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.138862 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.139006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.139146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.139286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.139426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.139582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.139725 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.139873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.140014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.140154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.140304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.140464 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.140608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.140756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.140905 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.141054 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.141195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.141345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.141493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.141648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.141797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.141949 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.142097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.143008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.143183 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.143449 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.143620 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.143766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.143926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.144580 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.145330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.145980 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.146147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.146292 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.146449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 18:06:57.146603 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.146809 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.146970 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.147123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.147274 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.147426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.147594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.147870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.148026 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.148170 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.148328 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.148478 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.148620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.148760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.148912 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.149053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.149208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.149362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.149512 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.149654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.149794 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.149941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.150091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.150234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.150377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.150517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.150667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.150833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.150999 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.151151 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.151293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.151448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.151591 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.151745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.151888 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.152028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.152168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.152336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.152889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.153780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.153947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.154092 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.154240 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.154383 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.154530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.154689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.154889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.154889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.155184 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.155337 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.155479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.155635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.155796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.156515 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.156667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.156810 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.156950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.157100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.157242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.157395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.157538 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.157927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.158073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.158227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.158375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.158531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.158674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.158852 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.158995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.159153 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.159475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.159626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.159768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.159917 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.160058 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.160197 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.161056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.161219 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.161370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.161513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.161664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.161814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.161967 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.162109 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.162257 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.162400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.162558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.163279 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.163549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.163721 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.163994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.164150 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.164292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.164440 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.164595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.164744 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.164908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.165061 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.165203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.165353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.165496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.165647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.165796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.165938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.166079 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.166229 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.166378 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.166520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.166661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.166825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.166979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.167136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.167278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.167430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.167582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.167723 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.167864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.168096 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.168249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.168390 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.168537 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.168679 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.169047 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.169213 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.169358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.169505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.169655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.169809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.169959 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.170100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.170412 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.170572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.170572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.170906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171060 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171395 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171661 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171744 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.171912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172162 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172244 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172759 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.172863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.173265 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.173361 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.173461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.173720 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.173812 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.173902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174091 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174711 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174805 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.174971 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175059 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175154 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175237 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175406 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175576 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175748 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.175985 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.176081 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.176634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.176753 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.176844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.176927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177009 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177264 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177353 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177442 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177605 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177694 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.177954 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178325 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178406 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.178976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179155 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179246 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179334 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179592 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.179954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180220 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.180975 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181151 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181239 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.181922 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182092 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182416 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182503 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182590 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182683 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182792 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.182958 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.183064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.183167 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.183414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.183497 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.183567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.183669 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.183918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184364 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184446 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.184970 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185307 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185477 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185559 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.185998 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186423 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.186693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187047 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187473 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187565 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187653 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187833 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.187915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188013 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188197 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188374 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188455 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188543 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188630 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.188987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189416 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189585 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189760 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.189843 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190212 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190295 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190465 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190751 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.190926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.191020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.191159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.191251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.191472 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.192344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.192449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.192548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.192638 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.192885 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.192983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.193199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.193296 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.193537 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.193624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.193843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.193944 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.194136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.194255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.194445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.194544 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.194785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.194904 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.195107 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.195208 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.195417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.195596 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.195744 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.195932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.196060 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.196368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.196677 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.196994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.197075 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.197300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.197396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.197608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.197689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.197923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.198010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.198242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.198330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.198560 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.198640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.198894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.199015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.199209 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.199307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.199514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.199595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.199822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.199901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201372 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201708 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201798 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201798 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.201961 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202388 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.202872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.203201 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.203537 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.204018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.204132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.204233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.204303 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.204540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.204641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.204912 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.205014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.205224 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.205321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.205540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.205628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.205859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.205948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.206171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.206261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.206483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.206572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.206820 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.206914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.207254 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.207411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.207567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.207718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.207873 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.208034 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.208177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.208315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.208443 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.208621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.208725 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.208945 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.209039 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.209261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.209352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.209574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.209672 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.209905 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.209996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.210220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.210320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.210530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.210620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.210866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.210973 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.211178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.211269 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.211519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.211621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.211827 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.211917 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.212141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.212237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.212457 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.212555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.212770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.212861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.213084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.213181 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.213399 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.213494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.213730 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.213826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.214016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.214114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.214329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.214428 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.214642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.214765 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.214986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.215095 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.215297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.215388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.215605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.215694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.215919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.216014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.216230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.216321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.216543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.216640 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.216858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.216948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.217163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.217260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.217474 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.217569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.217780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.217876 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.218094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.218186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.218402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.218492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.218724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.218862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.219042 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.219180 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.219357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.219495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.219670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.219803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.219979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.220116 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.220294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.220428 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.220603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.220746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.220925 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.221064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.221235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.221373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.221545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.221795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.221886 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.222108 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.222197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.222422 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.222520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.223283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.223488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.223684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.223808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224087 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224225 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224668 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.224983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.225190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.225282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.225501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.225599 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.225818 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.225915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.226141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.226230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.226462 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.226553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.226800 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.226910 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.227122 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.227220 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.227432 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.227530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.227744 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.227916 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.228055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.228233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.228370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.228548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.228680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.228876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.228991 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.229205 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.229306 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.229537 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.229672 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.229851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.229956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.230167 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.230259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.230481 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.230580 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.230834 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.230940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.231148 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.231240 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.231459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.231551 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.231777 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.231872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.232089 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.232179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.232416 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.232515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.232746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.232843 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.233065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.233161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.233389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.233478 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.233703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.233794 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.234021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.234296 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.234392 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.234474 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.234646 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.234791 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.235006 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.235125 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.235323 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.235415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.235642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.235732 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.235955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.236054 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.236265 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.236356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.236573 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.236670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.236896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.236994 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.237205 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.237303 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.237520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.237609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.237834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.237924 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.238146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.238237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.239167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.239668 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.239776 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.239877 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.239961 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240220 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240418 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240590 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240738 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.240906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.241065 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.241222 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.241390 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.241538 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.241698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.241856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.242025 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.242170 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.242338 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.242481 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.242645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.242840 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.242978 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.243163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.243291 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.243457 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.243633 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.243792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.243923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.244243 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.244548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.244658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.244871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.245003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.245188 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.245287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.245497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.245587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.245815 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.245907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.246129 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.246227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.246456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.246554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.246811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.246940 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.247119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.247259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.247426 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.247573 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.247737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.247891 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.248043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.248209 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.248350 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.248532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.248656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.248853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.248950 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.249163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.249261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.249554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.249643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.249860 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.249950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.250183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.250286 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.250488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.250579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.250872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.250978 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.251213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.251303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.251518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.251614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.251826 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.251923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.252132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.252257 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.252476 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.252612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.252782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.252926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.253121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.253258 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.253444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.253571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.253772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.253920 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.254137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.254445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255538 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255628 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.255918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.256018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.256242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.256334 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.256576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.256667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.256911 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.257009 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.257244 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.257335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.257560 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.257649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.257877 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.257974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.258196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.258286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.258818 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.259037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.259157 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.259369 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.259470 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.259689 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.259787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.260006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.260112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.260325 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.260430 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.260640 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.260738 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.260956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.261046 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.261291 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.261389 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.261606 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.261789 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.261922 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.262120 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.262222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.262439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.262558 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.262794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.262909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.263130 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.263223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.263445 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.263565 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.263759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.263885 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.264077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.264206 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.264389 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.264526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.264708 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.264844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.265042 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.265204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.265433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.265546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.265670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.265822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.265987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.266141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.266304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.266462 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.266615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.266800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.266954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.267118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.267282 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.267430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.267594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.267747 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.267923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.268062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.268244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.268375 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.268573 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.268671 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.268901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.268992 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.269214 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.269311 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.269544 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.269664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.270113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.270223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.270317 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.270399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.270575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.270674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.270918 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.271019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.271237 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.271334 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.271571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.271760 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.271901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.272078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.272240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.272413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.272578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.272739 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.272899 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.273066 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.273241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.273385 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.273575 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.273705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.273900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.274033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.274226 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.274333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.274562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.274653 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.274902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.274994 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.275219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.275331 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.275539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.275668 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.275853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.275957 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.276163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.276256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.276468 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.276554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.276780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.276869 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.277089 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.277179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.277398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.277631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.277730 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.277985 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.278083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.278322 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.278417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.278637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.278757 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.278979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.279062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.279291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.279388 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.279601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.279690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.279909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.280005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.280227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.280324 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.280537 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.280634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.280856 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.280954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.281169 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.281266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.281478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.281577 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.281787 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.281884 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.282101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.282198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.282414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.282518 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.282796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.282902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.283054 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.283145 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.283362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.283465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.283691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.283781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.284000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.284090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.284308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.284407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.284617 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.284710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.284928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.285018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.286192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.286437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.286551 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.286651 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.286757 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.286845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.286919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.287040 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.287328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.287421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.287668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.287767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.287996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.288088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.288319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.288417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.288641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.288733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.288959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.289051 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.289276 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.289373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.289597 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.289689 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.289916 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.290008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.290221 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.290314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.290540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.290857 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.290944 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.291032 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.291210 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.291302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.291528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.291632 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.291843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.291941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.292193 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.292292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.292517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.292620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.292841 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.293057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.293155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.293397 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.293502 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.293723 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.293815 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.294060 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.294157 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.294395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.294499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.294749 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.294857 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.295039 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.295131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.295352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.295451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.295681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.295772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.295997 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.296094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.296316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.296427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.296628 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.296716 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.296942 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.297028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.297256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.297347 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.297569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.297667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.297882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.297973 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.298263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.298356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.298579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.298669 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.298927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.299028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.299244 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.299334 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.299558 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.299656 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.299875 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.300083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.300219 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.300406 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.300542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.300747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.300863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.301128 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.301263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.301462 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.301674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.301786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.301995 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.302112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.302312 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.302445 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.302627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.302780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.302968 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.303094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.303289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.303413 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.303622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.303721 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.303941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.304033 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.304250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.304347 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.304643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.304733 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.304954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.305048 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.305280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.305370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.305595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.305694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.305909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.306182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.306276 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.306550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.306653 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.306903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.306996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.307230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.307320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.307548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.307645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.307882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.307980 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.308192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.308281 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.308523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.308627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.308837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.308929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.309155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.309276 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.309461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.309574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.309767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.309860 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.310076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.310166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.310387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.310488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.310788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.310883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.311026 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.311118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.311335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.311439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.311645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.311734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.311951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.312048 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.312256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.312348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.312563 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.312653 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.312869 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.312960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.313177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.313267 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.313483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.313574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.313789 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.313888 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.314092 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.314189 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.314399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.314490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.314719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.314823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.315041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.315132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.315351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.315448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.315658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.315758 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.316021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.316146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.316273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.317152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.317242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.317325 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.317530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.317617 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.317931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.318043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.318271 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.318365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.318591 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.318690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.318943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.319035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.319257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.319363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.319584 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.319682 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.319897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.319996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.320223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.320315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.320547 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.320636 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.320864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.320951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.321180 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.321279 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.321516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.321739 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.321829 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.322079 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.322183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.322404 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.322504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.322757 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.322851 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.323076 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.323180 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.323394 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.323494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.323705 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.323796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.324017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.324109 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.324340 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.324437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.324662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.324767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.324980 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.325072 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.325316 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.325419 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.325615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.325705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.325929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.326028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.326242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.326332 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.326557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.326657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.326897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.326989 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.327213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.327316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.327527 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.327633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.327839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.327929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.328155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.328256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.328472 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.328575 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.328804 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.328895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.329126 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.329222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.329440 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.329530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.329760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.329851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.330081 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.330181 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.330398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.330492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.330722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.330827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.331055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.331146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.331370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.331469 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.331693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.331785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.332016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.332105 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.332883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.333080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.333180 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 18:06:57.333399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.333827 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.334150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.334476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.334836 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.335158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.335487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.335848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.336131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.336459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.336778 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.337113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.337458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.337793 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.338125 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.338437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.338772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.339087 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.339404 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.339729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.340048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.340357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.340669 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.340987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.341299 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.341609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.341919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.342230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.342544 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.342880 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.343197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.343509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.343820 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.344130 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.344440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.344760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.345071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.345383 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.345723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.346047 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.346621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.347044 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.347518 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.348016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.348495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.348868 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.349204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.349525 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.349858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.350188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.350516 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.350863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.351208 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.351530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.351853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.352174 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.352494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.352814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.353153 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.353466 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.353800 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.354115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.354450 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.354799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.355138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.355464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.355786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.356127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.356446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.356765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.357090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.357411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.357731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.358057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.358384 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.358736 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.359078 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.359398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.359733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.360070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.360424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.360745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.361099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.361433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.361756 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.362077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.362391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 18:06:57.362639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 18:06:57.392895 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Registered counter for database nova_api May 23 18:06:57.413345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.420753 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.423100 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Registered counter for database nova_api May 23 18:06:57.443490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.450831 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.477951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.context [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13b6f0a-8239-4130-98e7-0248b4fd2533(cell1) {{(pid=117928) load_cells /opt/stack/nova/nova/context.py:464}} May 23 18:06:57.482088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:06:57.483726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:06:57.484530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:06:57.486494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:06:57.489018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Registered counter for database nova_cell0 May 23 18:06:57.493185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Registered counter for database nova_cell1 May 23 18:06:57.501270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.501980 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.507619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.508982 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.context [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13b6f0a-8239-4130-98e7-0248b4fd2533(cell1) {{(pid=117929) load_cells /opt/stack/nova/nova/context.py:464}} May 23 18:06:57.513181 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:06:57.514833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:06:57.515648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:06:57.517662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:06:57.520219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Registered counter for database nova_cell0 May 23 18:06:57.524315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Registered counter for database nova_cell1 May 23 18:06:57.531834 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.534131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.539621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.648764 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.658650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Registered counter for database nova_cell0 May 23 18:06:57.666029 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.670432 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.682871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.693259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Registered counter for database nova_cell0 May 23 18:06:57.700295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 18:06:57.704737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 18:06:57.992582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 18:06:57.999898 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 18:06:58.030073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 18:06:58.038446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 18:06:58.349404 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 18:06:58.355417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-8a02f2cc-7c63-4116-9cd9-060e4fbaddbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 18:06:58.360758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c096b49c0 pid: 117928 (default app) May 23 18:06:58.385524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 18:06:58.391559 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-96c9fc54-2785-430b-8aa7-a41a59dd7ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 18:06:58.397554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c096b49c0 pid: 117929 (default app) May 23 18:07:39.217444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:39.218550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:39.219614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:39.220444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:40.380121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7e4e252f-ea71-4c94-9901-e6cccb201b13 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Action: 'create', calling method: .version_select at 0x7f8c1d07fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1274128535"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:07:43.197437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7e4e252f-ea71-4c94-9901-e6cccb201b13 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.988751 May 23 18:07:43.204682 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1154 bytes} [Mon May 23 18:07:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3991 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 18:07:43.214105 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:43.215075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:43.216446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:43.217250 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:43.517178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-35d113ce-7f19-47b6-baf8-29fea1cdd70e tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1d04d8b0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:43.716978 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-904586516", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "networks": [{"uuid": "9f4b8762-4937-407c-b26f-19b08d357376"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:07:44.020232 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] validate_networks() for [('9f4b8762-4937-407c-b26f-19b08d357376', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:07:44.249580 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-35d113ce-7f19-47b6-baf8-29fea1cdd70e tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8" status: 200 len: 345 microversion: 2.1 time: 1.040754 May 23 18:07:44.250266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:07:43 2022] GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 => generated 345 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:45.263584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb3910e3-a8b1-41c2-86a2-ebb07fdc7758 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1cf14b80>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:45.604920 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb3910e3-a8b1-41c2-86a2-ebb07fdc7758 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8" status: 200 len: 346 microversion: 2.1 time: 0.345292 May 23 18:07:45.605506 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:07:45 2022] GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 => generated 346 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:45.619779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d6ed5417-e2eb-4b95-b971-b58bd602aed4 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Action: 'create', calling method: .version_select at 0x7f8c1ced01f0>, body: {"snapshot": {"volume_id": "b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1000171468"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:07:46.218622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d6ed5417-e2eb-4b95-b971-b58bd602aed4 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.604451 May 23 18:07:46.220657 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 3/4] 10.222.0.30 () {60 vars in 1161 bytes} [Mon May 23 18:07:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:07:46.230626 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0a888c8-8e78-477b-8f3e-d7461df70713 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1cf14af0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:46.323441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0a888c8-8e78-477b-8f3e-d7461df70713 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.096771 May 23 18:07:46.324685 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 4/5] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:46 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:07:46.335265 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ad353933-129a-4917-92b8-6dd399b11d00 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1ced0a60>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:46.456241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ad353933-129a-4917-92b8-6dd399b11d00 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.125376 May 23 18:07:46.457074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 5/6] 10.222.0.30 () {58 vars in 1139 bytes} [Mon May 23 18:07:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:07:46.468347 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6f210a87-ed5d-4220-8438-5b3d1e103bb0 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1cee0790>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:46.517073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:07:46.517497 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:07:46.524767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:07:46.525196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:07:46.525618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:07:46.566619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:46.567208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:46.568095 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:46.568532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:46.591190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6f210a87-ed5d-4220-8438-5b3d1e103bb0 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.127263 May 23 18:07:46.592404 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 6/7] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:46 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:07:46.689860 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Getting quotas for project b3e941f449f34bcaa50de8b5d87b9389. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:07:46.712587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Getting quotas for user 38349aaa207c4703a18f512ad2f95196 and project b3e941f449f34bcaa50de8b5d87b9389. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:07:46.765303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:07:46.768246 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:07:46.967133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08a4d231-681b-4cf8-b990-6cd8cbd6ff93 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.685943 May 23 18:07:46.969257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 2/8] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:07:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:07:46.983167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-49c4a3a8-7609-4ab2-baee-e0d7cf31f971 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:46.983964 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-49c4a3a8-7609-4ab2-baee-e0d7cf31f971 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:47.530399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-49c4a3a8-7609-4ab2-baee-e0d7cf31f971 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:47.546532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-49c4a3a8-7609-4ab2-baee-e0d7cf31f971 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1214 microversion: 2.1 time: 0.569055 May 23 18:07:47.547697 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 7/9] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:46 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1214 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:07:47.605228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba0bee94-6e7c-41c0-acdd-9edd3bd856a4 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c5e5700>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:47.701601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba0bee94-6e7c-41c0-acdd-9edd3bd856a4 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.101584 May 23 18:07:47.702687 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 3/10] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:47 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:48.577879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2d954d46-1248-4e88-80d7-b43477a9fa79 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:48.578509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2d954d46-1248-4e88-80d7-b43477a9fa79 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:48.713621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-63a5d3a2-cff6-475e-b28c-fcdab252b47a tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c5e5d30>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:48.776554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2d954d46-1248-4e88-80d7-b43477a9fa79 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:48.787164 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2d954d46-1248-4e88-80d7-b43477a9fa79 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1214 microversion: 2.1 time: 0.223595 May 23 18:07:48.789505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-63a5d3a2-cff6-475e-b28c-fcdab252b47a tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.078572 May 23 18:07:48.789505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 4/11] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:48 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:48.801654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 8/12] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:48 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1214 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:07:49.804443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2455504c-ef57-40c6-9fbc-a8b0a1e4071c tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c5e5550>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:49.818687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:49.820786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:49.858328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:49.859190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:49.860255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:49.860888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:49.872659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2455504c-ef57-40c6-9fbc-a8b0a1e4071c tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.074853 May 23 18:07:49.873237 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 5/13] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:49 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:50.547792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:50.570294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-07d911a2-53e5-400e-9bd1-5f605653667e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1218 microversion: 2.1 time: 0.758441 May 23 18:07:50.574574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 9/14] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:49 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1218 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:07:50.894660 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e19e9096-2a0b-4955-a63c-38eec4dab5f0 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c585280>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:50.956645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e19e9096-2a0b-4955-a63c-38eec4dab5f0 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.075998 May 23 18:07:50.957814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 6/15] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:50 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:51.496799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2002688088", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:07:51.593178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:51.593801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:51.621711 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:51.622175 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:51.623003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:51.623444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:51.718476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] validate_networks() for [('7a57948d-e894-48fd-8fca-36b77c7b9fb4', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:07:51.989781 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:52.019674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dd2dc332-540c-4915-9fe8-ed751c265c1c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1218 microversion: 2.1 time: 0.432219 May 23 18:07:52.021600 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 7/16] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:51 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:07:52.044150 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f842d83d-2d55-4ccc-909b-9a9413542a0b tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c579ca0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:52.109984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f842d83d-2d55-4ccc-909b-9a9413542a0b tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.085767 May 23 18:07:52.110552 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:52 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:53.037782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:53.041634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:53.056361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:53.061802 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:53.066390 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:53.068255 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:53.271881 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:53.295529 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e8fcc7b4-76d3-406b-89b5-05c625c3568e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1274 microversion: 2.1 time: 0.261546 May 23 18:07:53.307857 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 9/18] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:53 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:07:53.313166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-572ae584-d74b-4cfb-87a1-a2285817c737 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c538ca0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:53.418752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-572ae584-d74b-4cfb-87a1-a2285817c737 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 288 microversion: 2.1 time: 0.109414 May 23 18:07:53.419720 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 10/19] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:53 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 288 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:53.438620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e8ba216d-0eaf-402e-a6e6-e8ca61f7c68e tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c4db430>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:53.620550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e8ba216d-0eaf-402e-a6e6-e8ca61f7c68e tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 202 len: 0 microversion: 2.1 time: 0.193848 May 23 18:07:53.621506 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 11/20] 10.222.0.30 () {58 vars in 1253 bytes} [Mon May 23 18:07:53 2022] DELETE /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 18:07:53.633213 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b781c380-e253-49a4-9dbc-d0dc28e99c30 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c4e0310>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:53.701731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b781c380-e253-49a4-9dbc-d0dc28e99c30 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 200 len: 287 microversion: 2.1 time: 0.075485 May 23 18:07:53.702729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 12/21] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:53 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:07:54.315853 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:54.316522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:54.329529 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:54.331108 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:54.331407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:54.331852 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:54.980715 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:54.990014 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bfab2cf5-f8b0-4a15-9948-05e13ddc1d29 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1272 microversion: 2.1 time: 0.679247 May 23 18:07:54.990604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 13/22] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:54 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1272 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:07:55.007649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9c76334-88b7-40a6-9807-a2088ada60f7 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c4db280>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:55.061123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-d9c76334-88b7-40a6-9807-a2088ada60f7 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] HTTP exception thrown: Snapshot ffc86c42-334d-483d-a8e8-53d528d58faa could not be found. May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9c76334-88b7-40a6-9807-a2088ada60f7 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Request method failure captured: May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa HTTP/1.1 May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii81rjOPn4WUJuDqm4CXNbdU8N0FqeHSgrbk-MmxYE1noTb4fZtkhOtI0Wbyy8eWlMhxSyxqKeMH6BGnrrV2FOqkQbm5CxysqReQSq4rAvM5pT93ks0cv1v0t_GJNWeFHsl9H5dKXzP1ysH2PsxdxZ1hmA6YOQrG3szgkOgSZvHombQY May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:07:55.066119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 7e947a9f2fe24dae963621b64b9a3968 May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Snapshot ffc86c42-334d-483d-a8e8-53d528d58faa could not be found. May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'ffc86c42-334d-483d-a8e8-53d528d58faa'} May 23 18:07:55.067569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ffc86c42-334d-483d-a8e8-53d528d58faa could not be found. (HTTP 404) (Request-ID: req-c57fd780-e407-4595-a64a-09252e6a2afe) May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:55.068336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:07:55.069402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ffc86c42-334d-483d-a8e8-53d528d58faa could not be found. May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 18:07:55.070501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ffc86c42-334d-483d-a8e8-53d528d58faa could not be found. May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ffc86c42-334d-483d-a8e8-53d528d58faa could not be found. May 23 18:07:55.071780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:55.074362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9c76334-88b7-40a6-9807-a2088ada60f7 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Returning 404 to user: Snapshot ffc86c42-334d-483d-a8e8-53d528d58faa could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:07:55.075433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d9c76334-88b7-40a6-9807-a2088ada60f7 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa" status: 404 len: 111 microversion: 2.1 time: 0.078988 May 23 18:07:55.076154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 14/23] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:07:54 2022] GET /compute/v2.1/os-snapshots/ffc86c42-334d-483d-a8e8-53d528d58faa => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:07:55.090012 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-47b7d791-c9a0-4d5e-8fa6-5d3b72486412 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1d860310>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:55.350025 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-47b7d791-c9a0-4d5e-8fa6-5d3b72486412 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8" status: 202 len: 0 microversion: 2.1 time: 0.267414 May 23 18:07:55.351007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 15/24] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:07:55 2022] DELETE /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:07:55.370119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4576469b-13d7-455c-bc29-b425cd3e1e7a tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c4db4c0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:55.537924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4576469b-13d7-455c-bc29-b425cd3e1e7a tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8" status: 200 len: 345 microversion: 2.1 time: 0.181184 May 23 18:07:55.539432 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 16/25] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:07:55 2022] GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:07:55.863773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:07:55.865032 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:07:55.865723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:07:55.866329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:07:55.867066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:07:55.924242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:55.927034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:55.928312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:55.934368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:56.067928 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for project 74d48ee3a0df47dab968b0b92443648c. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:07:56.097823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for user a57822c1558143d38ad17326a742c370 and project 74d48ee3a0df47dab968b0b92443648c. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:07:56.158395 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:07:56.175976 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:07:56.512187 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ffdab3fd-b894-44c8-9fec-401254d3e0c5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.346271 May 23 18:07:56.520155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 10/26] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:07:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 5355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:07:56.536218 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:56.552483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:56.593429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:56.601292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:56.603912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:56.610250 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:56.631651 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:56.752387 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:57.048194 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cba5ca66-cece-4caf-8585-cfb7784069d0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'create', calling method: .version_select at 0x7f8c1c4db550>, body: {"keypair": {"name": "tempest-keypair-1079657828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOnhHbc2OxkUq86gNBF0CJtGCoIdZrDrDpSYMfTm+o2e3fAWClJf1x4+4MWGr99USO0VXiUkhq2wXYd5xXm7p9cf17Hn+OtNzSXShkfNO/deaJdDQUy85I/QO6FgTcHLA=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:07:57.166644 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-cba5ca66-cece-4caf-8585-cfb7784069d0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for project c69b4fff47194d4fbd1188521b31dce8. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:07:57.192573 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-cba5ca66-cece-4caf-8585-cfb7784069d0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for user 32e9879d092b4c819f1f5607f42cc364 and project c69b4fff47194d4fbd1188521b31dce8. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:07:57.349554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cba5ca66-cece-4caf-8585-cfb7784069d0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.628421 May 23 18:07:57.354456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 17/27] 10.222.0.30 () {62 vars in 1199 bytes} [Mon May 23 18:07:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1639 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 23 18:07:57.383909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ebe0794-f2e9-41d4-8d47-6ec54857a496 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:57.384859 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ebe0794-f2e9-41d4-8d47-6ec54857a496 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:57.597686 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ebe0794-f2e9-41d4-8d47-6ec54857a496 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:57.623522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ebe0794-f2e9-41d4-8d47-6ec54857a496 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1222 microversion: 2.1 time: 0.266753 May 23 18:07:57.645738 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 18/28] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:57 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1222 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:07:57.673652 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dd8f5b80-53ab-48a5-a506-bb56bd494309 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c4db9d0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:57.764080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-dd8f5b80-53ab-48a5-a506-bb56bd494309 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] HTTP exception thrown: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dd8f5b80-53ab-48a5-a506-bb56bd494309 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Request method failure captured: May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 HTTP/1.1 May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii81rjOPn4WUJuDqm4CXNbdU8N0FqeHSgrbk-MmxYE1noTb4fZtkhOtI0Wbyy8eWlMhxSyxqKeMH6BGnrrV2FOqkQbm5CxysqReQSq4rAvM5pT93ks0cv1v0t_GJNWeFHsl9H5dKXzP1ysH2PsxdxZ1hmA6YOQrG3szgkOgSZvHombQY May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:07:57.770801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 7e947a9f2fe24dae963621b64b9a3968 May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8'} May 23 18:07:57.771933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. (HTTP 404) (Request-ID: req-d79123b1-cbea-476d-ad33-952dddf0d82a) May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:57.772577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:07:57.773516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 18:07:57.774434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.778762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.792049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dd8f5b80-53ab-48a5-a506-bb56bd494309 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Returning 404 to user: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:07:57.799941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dd8f5b80-53ab-48a5-a506-bb56bd494309 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8" status: 404 len: 109 microversion: 2.1 time: 0.150148 May 23 18:07:57.820813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 19/29] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:07:57 2022] GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 => generated 109 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:07:57.849439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:07:57.856148 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae9f0198-923f-47b9-ba7a-9bc0ec9182e8 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c44dee0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:57.877361 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ebbbb896-9776-4d9b-a2ec-4f348f01fe3c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 1.355599 May 23 18:07:57.898035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 11/30] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:56 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:07:57.955074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-ae9f0198-923f-47b9-ba7a-9bc0ec9182e8 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] HTTP exception thrown: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae9f0198-923f-47b9-ba7a-9bc0ec9182e8 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Request method failure captured: May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 HTTP/1.1 May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii81rjOPn4WUJuDqm4CXNbdU8N0FqeHSgrbk-MmxYE1noTb4fZtkhOtI0Wbyy8eWlMhxSyxqKeMH6BGnrrV2FOqkQbm5CxysqReQSq4rAvM5pT93ks0cv1v0t_GJNWeFHsl9H5dKXzP1ysH2PsxdxZ1hmA6YOQrG3szgkOgSZvHombQY May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:07:57.959313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 7e947a9f2fe24dae963621b64b9a3968 May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8'} May 23 18:07:57.960724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. (HTTP 404) (Request-ID: req-a0be8167-6ce2-4239-a335-d9fae1309912) May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:57.961438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 18:07:57.962504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 18:07:57.963882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:57.965513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:07:57.966914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae9f0198-923f-47b9-ba7a-9bc0ec9182e8 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Returning 404 to user: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:07:57.968719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae9f0198-923f-47b9-ba7a-9bc0ec9182e8 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8" status: 404 len: 109 microversion: 2.1 time: 0.146460 May 23 18:07:57.979126 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 20/31] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:07:57 2022] DELETE /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:07:57.982454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ef23ac1a-b8d2-4ec4-8075-c3e2df100685 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Calling method '.version_select at 0x7f8c1c4d9d30>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:58.052907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1550118562", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:07:58.056781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-ef23ac1a-b8d2-4ec4-8075-c3e2df100685 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] HTTP exception thrown: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ef23ac1a-b8d2-4ec4-8075-c3e2df100685 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Request method failure captured: May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 HTTP/1.1 May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii81rjOPn4WUJuDqm4CXNbdU8N0FqeHSgrbk-MmxYE1noTb4fZtkhOtI0Wbyy8eWlMhxSyxqKeMH6BGnrrV2FOqkQbm5CxysqReQSq4rAvM5pT93ks0cv1v0t_GJNWeFHsl9H5dKXzP1ysH2PsxdxZ1hmA6YOQrG3szgkOgSZvHombQY May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:07:58.062203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/67663c58bce243c7a6141d5d6da3322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 67663c58bce243c7a6141d5d6da3322c May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842755422 May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 7e947a9f2fe24dae963621b64b9a3968 May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842755422-project May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8'} May 23 18:07:58.063603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. (HTTP 404) (Request-ID: req-ba7c675a-3913-48cb-8707-6d55efb7b902) May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:58.064773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:07:58.065933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 18:07:58.066864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ef23ac1a-b8d2-4ec4-8075-c3e2df100685 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] Returning 404 to user: Volume b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ef23ac1a-b8d2-4ec4-8075-c3e2df100685 tempest-VolumesSnapshotsTestJSON-842755422 tempest-VolumesSnapshotsTestJSON-842755422-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8" status: 404 len: 109 microversion: 2.1 time: 0.085148 May 23 18:07:58.067734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 12/32] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:07:57 2022] GET /compute/v2.1/os-volumes/b49f6ccc-4e4c-4cde-8b4a-e9e9e095f1c8 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 18:07:58.305992 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] validate_networks() for [('7a57948d-e894-48fd-8fca-36b77c7b9fb4', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:07:58.913931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:07:58.914826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:07:58.937826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:58.938348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:07:58.947557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:07:58.948028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:00.185384 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:00.199343 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-65259622-9d9b-4962-a48f-c8e48446ee9d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 1.289638 May 23 18:08:00.199930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 13/33] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:07:58 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:01.219382 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:01.221297 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:01.231259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:01.231998 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:01.233023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:01.238071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:02.701252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:02.730908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-afe5bdf5-0fd6-4ec5-8ee9-c2aa444d766d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 1.515667 May 23 18:08:02.757780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 14/34] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:01 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:03.593768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:08:03.594278 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:08:03.594669 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:08:03.595342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:08:03.595772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:08:03.631183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:03.633628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:03.634578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:03.641273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:03.707397 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for project 74d48ee3a0df47dab968b0b92443648c. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:08:03.720581 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for user a57822c1558143d38ad17326a742c370 and project 74d48ee3a0df47dab968b0b92443648c. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:08:03.750509 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:08:03.753940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:08:03.859854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e994ddfd-3197-4a55-89ff-949578a64749 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.816946 May 23 18:08:03.868946 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 21/35] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:07:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 5829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 18:08:03.893191 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:03.893827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:03.944184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:03.944658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:03.945455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:03.945897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:04.069818 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96e0f71c-0a20-4c3f-8685-47c58388e1f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'create', calling method: .version_select at 0x7f8c1c47ee50>, body: {"keypair": {"name": "tempest-keypair-792161771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI028Dqd6NeGgtj2HHUTyxRbKt5CUkMRUyLKLBzLIf4+yqJV0TzzFSScTN+AY22Z5yQJTJh0BzenTrWkl2mYDX8Y0et7hhn20kEHJU2pkyb2o190+UQUhlUeVF3YQRtFDA=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:04.141431 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-96e0f71c-0a20-4c3f-8685-47c58388e1f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for project e00ef21138204550843697c5f33a8999. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:08:04.156120 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-96e0f71c-0a20-4c3f-8685-47c58388e1f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for user 8d08ba344a9349d99de16520d3ce5150 and project e00ef21138204550843697c5f33a8999. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:08:04.249837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96e0f71c-0a20-4c3f-8685-47c58388e1f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.079847 May 23 18:08:04.258802 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 15/36] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:08:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:04.272439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f283f16c-3012-4bd4-8a38-4de9f920f8a1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:04.273065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f283f16c-3012-4bd4-8a38-4de9f920f8a1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:04.516496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f283f16c-3012-4bd4-8a38-4de9f920f8a1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:04.537997 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f283f16c-3012-4bd4-8a38-4de9f920f8a1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1222 microversion: 2.1 time: 0.277763 May 23 18:08:04.538603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 16/37] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:04 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1222 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:05.662574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:05.681524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e2725663-939a-4475-b533-5d015257eaa8 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 1.810519 May 23 18:08:05.702974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 22/38] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:03 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:05.714536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:05.717127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:05.729974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:05.731047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:05.732251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:05.748283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:05.838631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-7ac0873a-c12b-458b-8c8a-f784e185c5a7 req-1eaa7753-4f66-4f7c-ac8b-389d81e499bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f341e2-47cb-4c4a-a410-2f4305c01382", "tag": "22e29b49-5f40-406f-b061-b06a7907af74"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:05.896468 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-7ac0873a-c12b-458b-8c8a-f784e185c5a7 req-1eaa7753-4f66-4f7c-ac8b-389d81e499bf service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:05.898864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-7ac0873a-c12b-458b-8c8a-f784e185c5a7 req-1eaa7753-4f66-4f7c-ac8b-389d81e499bf service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:05.932040 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-7ac0873a-c12b-458b-8c8a-f784e185c5a7 req-1eaa7753-4f66-4f7c-ac8b-389d81e499bf service nova] Creating event network-changed:22e29b49-5f40-406f-b061-b06a7907af74 for instance 99f341e2-47cb-4c4a-a410-2f4305c01382 on hv-cinder-75078 May 23 18:08:05.932727 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-7ac0873a-c12b-458b-8c8a-f784e185c5a7 req-1eaa7753-4f66-4f7c-ac8b-389d81e499bf service nova] Acquired lock "compute-rpcapi-router" {{(pid=117929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 18:08:05.934320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad8859a3-f5ad-43ff-9bd8-c2166f2241d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:05.935189 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad8859a3-f5ad-43ff-9bd8-c2166f2241d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:05.936388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad8859a3-f5ad-43ff-9bd8-c2166f2241d4 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:05.937073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad8859a3-f5ad-43ff-9bd8-c2166f2241d4 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:05.949730 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.compute.rpcapi [None req-ad8859a3-f5ad-43ff-9bd8-c2166f2241d4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 18:08:05.950994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad8859a3-f5ad-43ff-9bd8-c2166f2241d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 18:08:06.005252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ad8859a3-f5ad-43ff-9bd8-c2166f2241d4 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.664460 May 23 18:08:06.006152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 17/39] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:06.015244 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:06.028765 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-31568915-240d-43c1-a8ae-3146d4095e81 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1274 microversion: 2.1 time: 0.324024 May 23 18:08:06.036103 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 23/40] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:05 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:06.709885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:06.711641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:06.761576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:06.763048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:06.765438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:06.766225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:07.053611 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:07.054242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:07.067289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:07.073364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:07.075351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:07.076301 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:07.500769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:07.513826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:07.526585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c3cbe539-4ef4-44b3-bce9-6a6849f2a471 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.824136 May 23 18:08:07.527841 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8ed2cee4-8cd5-4813-afc1-4ad1f12a9553 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1280 microversion: 2.1 time: 0.479099 May 23 18:08:07.528433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 24/41] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:07 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1280 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:07.530846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 18/42] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:06 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:08.556837 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:08.560575 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:08.564880 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:08.568589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:08.595548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:08.597939 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:08.599012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:08.601184 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:08.607695 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:08.613426 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:08.614487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:08.616908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:09.099645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:09.111794 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-58e4ca38-e0dd-40c1-9240-407c324ea4f7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1280 microversion: 2.1 time: 0.570135 May 23 18:08:09.119070 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 25/43] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:08 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1280 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:09.834173 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:09.852933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bea8db3f-353e-4309-8b2e-2c4cb4f04200 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 1.311149 May 23 18:08:09.866301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 19/44] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:08 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:10.138510 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:10.140341 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:10.143909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:10.164190 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:10.164649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:10.165452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:10.165897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:10.225521 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=47 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:10.875341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:10.878666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:10.887719 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:10.902416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:10.904928 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:10.906231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:11.216745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:11.232207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b194fab-9643-4e84-9210-51815dec6974 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 1.099695 May 23 18:08:11.233092 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 26/45] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:10 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:11.697773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:11.715178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-113ae074-8ed2-4a5f-8b05-e527426c87e4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.844205 May 23 18:08:11.717932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 20/46] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:10 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:12.251401 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:12.252081 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:12.269835 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:12.269835 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:12.271430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:12.271667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:12.732296 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:12.733055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:12.759094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:12.760131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:12.766256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:12.771483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:13.248309 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:13.256087 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4b1095eb-5c4b-4e9d-be60-f022b9b4ac2f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 1.009703 May 23 18:08:13.259697 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 27/47] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:12 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:13.269923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:13.293742 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-49711e34-2690-410a-8a9d-2302666d0114 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.565404 May 23 18:08:13.303152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 21/48] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:12 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:13.506876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-f7d95ffc-fba4-41be-bd7a-d71a2089cbce req-ca8d4c57-c3b0-4a38-9bc8-2e18f39d1132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb843a05-dbd1-4fbf-94a9-1dff354593f0", "tag": "b9cadce7-4d82-436c-82ae-68af5f3a712a"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:13.552733 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f7d95ffc-fba4-41be-bd7a-d71a2089cbce req-ca8d4c57-c3b0-4a38-9bc8-2e18f39d1132 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:13.556931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f7d95ffc-fba4-41be-bd7a-d71a2089cbce req-ca8d4c57-c3b0-4a38-9bc8-2e18f39d1132 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:13.642251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-f7d95ffc-fba4-41be-bd7a-d71a2089cbce req-ca8d4c57-c3b0-4a38-9bc8-2e18f39d1132 service nova] Creating event network-changed:b9cadce7-4d82-436c-82ae-68af5f3a712a for instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 on hv-cinder-75078 May 23 18:08:13.642892 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f7d95ffc-fba4-41be-bd7a-d71a2089cbce req-ca8d4c57-c3b0-4a38-9bc8-2e18f39d1132 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 18:08:13.645958 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79ec3b0e-b369-426c-b955-09da2c2cc090 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:13.646495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79ec3b0e-b369-426c-b955-09da2c2cc090 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:13.648948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79ec3b0e-b369-426c-b955-09da2c2cc090 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:13.650266 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79ec3b0e-b369-426c-b955-09da2c2cc090 None None] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:13.674634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.compute.rpcapi [None req-79ec3b0e-b369-426c-b955-09da2c2cc090 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 18:08:13.675783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79ec3b0e-b369-426c-b955-09da2c2cc090 None None] Releasing lock "compute-rpcapi-router" {{(pid=117928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 18:08:13.726007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-79ec3b0e-b369-426c-b955-09da2c2cc090 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224595 May 23 18:08:13.726976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 28/49] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:13.929659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1725337504", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d2af0e3-a19a-418d-bc30-8536d057041d"}], "security_groups": [{"name": "tempest-securitygroup--1133857527"}], "key_name": "tempest-keypair-1079657828", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:13.956621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:14.164091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=12 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:14.262861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] validate_networks() for [('3d2af0e3-a19a-418d-bc30-8536d057041d', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:08:14.526259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=16 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:14.803736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-6fc86cba-0c86-4ff8-ae5f-97978c462e5b req-2ee17203-8cb3-4e3f-9d1e-b05788aea635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7f7689-8026-4116-b605-567d3ad605b1", "tag": "24192180-2c11-45fa-bcc6-613fdc478a7a"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:14.819646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6fc86cba-0c86-4ff8-ae5f-97978c462e5b req-2ee17203-8cb3-4e3f-9d1e-b05788aea635 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:14.821113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6fc86cba-0c86-4ff8-ae5f-97978c462e5b req-2ee17203-8cb3-4e3f-9d1e-b05788aea635 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:14.848140 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-6fc86cba-0c86-4ff8-ae5f-97978c462e5b req-2ee17203-8cb3-4e3f-9d1e-b05788aea635 service nova] Creating event network-changed:24192180-2c11-45fa-bcc6-613fdc478a7a for instance 7a7f7689-8026-4116-b605-567d3ad605b1 on hv-cinder-75078 May 23 18:08:14.848612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:08:14.849132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:08:14.849797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:08:14.850434 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:08:14.851144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:08:14.857328 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-6fc86cba-0c86-4ff8-ae5f-97978c462e5b req-2ee17203-8cb3-4e3f-9d1e-b05788aea635 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.693752 May 23 18:08:14.858863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 29/50] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:08:14.863333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:14.863877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:14.864927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:14.865477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:14.867092 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:14.867936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:14.875487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:14.876406 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:14.877208 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=55 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:14.877338 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:14.877762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:14.896145 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for project c69b4fff47194d4fbd1188521b31dce8. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:08:14.901193 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for user 32e9879d092b4c819f1f5607f42cc364 and project c69b4fff47194d4fbd1188521b31dce8. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:08:14.916944 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:08:14.919649 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:08:15.021960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-011c76c0-e9f5-42f4-aec7-0af767bdb08e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.112660 May 23 18:08:15.023314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 22/51] 10.222.0.30 () {62 vars in 1187 bytes} [Mon May 23 18:08:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 18:08:15.035748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:15.036375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:15.044616 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:15.045293 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:15.046288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:15.046955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:15.151223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:15.159543 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-66a0329c-af19-43aa-9e12-8ec296fc5567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.298885 May 23 18:08:15.160123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 30/52] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:14 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:15.182263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-996742571", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9540f4ea-42f0-45da-912b-c95b248937e6"}], "security_groups": [{"name": "tempest-securitygroup--40081326"}], "key_name": "tempest-keypair-792161771", "user_data": "}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:15.342501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:15.351571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-93534a44-2a7a-4f67-a3e1-f7ba74618995 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.327097 May 23 18:08:15.354983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 23/53] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:15 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:15.368232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3af6c9cb-519b-4c2f-b800-c315775eba7f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:15.372482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3af6c9cb-519b-4c2f-b800-c315775eba7f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:15.467700 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] validate_networks() for [('9540f4ea-42f0-45da-912b-c95b248937e6', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:08:15.500317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3af6c9cb-519b-4c2f-b800-c315775eba7f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:15.501560 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3af6c9cb-519b-4c2f-b800-c315775eba7f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:15.503723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3af6c9cb-519b-4c2f-b800-c315775eba7f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:15.505421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3af6c9cb-519b-4c2f-b800-c315775eba7f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1282 microversion: 2.20 time: 0.152311 May 23 18:08:15.507230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 24/54] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:15 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:15.979362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:08:15.979859 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:08:15.980955 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:08:15.980955 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:08:15.981142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:08:15.992361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:15.993141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:15.994135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:15.994795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:16.028136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for project e00ef21138204550843697c5f33a8999. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:08:16.036185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for user 8d08ba344a9349d99de16520d3ce5150 and project e00ef21138204550843697c5f33a8999. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:08:16.054619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:08:16.057142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:08:16.123696 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6478fdf4-7042-49f3-8c14-2e0f02f9c14b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.962189 May 23 18:08:16.124724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 31/55] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:08:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:08:16.135501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-196898f6-03e9-404c-835f-01fa32bcb330 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:16.136327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-196898f6-03e9-404c-835f-01fa32bcb330 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:16.176620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:16.177867 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:16.195398 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:16.198154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:16.200650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:16.202752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:16.255991 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-196898f6-03e9-404c-835f-01fa32bcb330 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:16.265154 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-196898f6-03e9-404c-835f-01fa32bcb330 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1236 microversion: 2.1 time: 0.133483 May 23 18:08:16.266129 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 25/56] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:16 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1236 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:16.369809 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:16.370512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:16.383626 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:16.384079 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:16.384855 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:16.388303 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:16.457383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:16.470913 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fdc69660-0bd1-45f5-8cb0-16a0f219d095 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.298420 May 23 18:08:16.472672 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 32/57] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:16 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:16.533178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:16.535129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:16.552587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:16.554694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:16.555530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:16.555974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:16.626203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:16.634436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9598114b-c930-4a3a-93f9-ff11aed7460c tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.268903 May 23 18:08:16.646225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 26/58] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:16 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:16.649284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:16.659577 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:16.661126 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:16.662224 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ced83db4-d4e9-4d5c-a209-7f74f18da7b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1286 microversion: 2.20 time: 0.136862 May 23 18:08:16.662816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 33/59] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:16 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:17.283737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:17.284346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:17.290289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.290762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.291526 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.291958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.363487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:17.371888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-449353ce-6b32-442e-8c98-dce79c69ae9b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1240 microversion: 2.1 time: 0.092431 May 23 18:08:17.372526 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 27/60] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:17 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:17.489650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:17.490538 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:17.499047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.503731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.504707 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.505152 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.641850 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:17.649413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-563a6cb6-c94a-4493-85a3-e41d9e47cc3b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.164897 May 23 18:08:17.649980 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 34/61] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:17 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:17.652555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:17.653183 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:17.659851 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.660294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.661236 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.661670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.680452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:17.681241 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:17.687373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.687829 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.689273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:17.689713 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:17.757228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:17.765937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:17.767666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:17.769064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b74f579b-a1af-4f6c-b3b3-c19c48f6c966 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1286 microversion: 2.20 time: 0.092362 May 23 18:08:17.769956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 35/62] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:17 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:17.856737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:17.865928 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-78a2733c-d271-4647-994e-a7afd1f808d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.217497 May 23 18:08:17.866507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 28/63] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:17 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:18.389768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:18.390380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:18.397448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.397973 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:18.399005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.399538 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:18.468993 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:18.476752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-286217dd-3d40-44cb-9c77-57bdc338c22d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1240 microversion: 2.1 time: 0.090818 May 23 18:08:18.477509 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 36/64] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:18 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:18.671864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:18.672917 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:18.679867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.680652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:18.681258 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.681903 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:18.790740 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:18.790740 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:18.799735 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.800458 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:18.801230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.801658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:18.829857 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:18.838632 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4d75417b-cb46-4e91-a315-7b35adc59391 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.171460 May 23 18:08:18.849655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 29/65] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:18 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:18.868456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:18.877743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:18.879916 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:18.883133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-000e2617-a7c0-4d56-9534-561133ba702f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1286 microversion: 2.20 time: 0.097790 May 23 18:08:18.883265 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:18.883859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:18.895340 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 37/66] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:18 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:18.895748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.895748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:18.895748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:18.895748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:19.029507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:19.038137 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-51609c24-dd8e-40ac-8d31-60669b9c7ba5 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.159231 May 23 18:08:19.038740 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 30/67] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:18 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:19.495886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:19.496893 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:19.508377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:19.515245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:19.516336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:19.517273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:19.763943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:19.793601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8a770d82-81dc-4dd2-ad85-05206c05b021 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1240 microversion: 2.1 time: 0.296229 May 23 18:08:19.796222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 38/68] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:19 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1240 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:19.857415 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:19.858922 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:19.870650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:19.873508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:19.876901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:19.878553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:19.904100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:19.905130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:19.921409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:19.923450 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:19.924428 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:19.931030 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:20.124784 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:20.136896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:20.139068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:20.140483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-167a81aa-4b5c-4492-94ad-85e54ae30075 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1334 microversion: 2.20 time: 0.241490 May 23 18:08:20.142140 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 39/69] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:19 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1334 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:08:20.149099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:20.150294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:20.162171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:20.163186 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:20.164306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:20.165130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:20.343979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:20.365560 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8e729a1e-e5b3-4801-83b4-d4bbe45b40d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.508885 May 23 18:08:20.392618 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 31/70] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:19 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:20.826506 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:20.827623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:20.837188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:20.838227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:20.839312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:20.840208 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:20.881136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:20.889631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f0e2db54-02ad-4b21-8ece-211ebf88568b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.746098 May 23 18:08:20.890451 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 40/71] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:20 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:21.034438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:21.051417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8358bca6-d5e1-4cf9-b0df-2aa619c39449 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1294 microversion: 2.1 time: 0.231190 May 23 18:08:21.055034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 32/72] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:20 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1294 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:21.160519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:21.161262 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:21.185747 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:21.189076 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:21.192642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:21.193322 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:21.387700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:21.388863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:21.401686 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:21.402531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:21.403578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:21.404241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:21.752283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:21.760726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:21.767837 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:21.771195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-38405f95-eafd-4a9a-a0df-2976453881a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1340 microversion: 2.20 time: 0.615345 May 23 18:08:21.773453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 41/73] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:21 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1340 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:21.908111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:21.909697 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:21.915956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:21.916698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:21.917675 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:21.918393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:21.994951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:22.012812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6ae7c076-d3b4-40d9-bc14-322985d112cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.627843 May 23 18:08:22.014003 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 33/74] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:21 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:22.072125 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:22.072766 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:22.079612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:22.080533 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:22.081533 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:22.082268 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:22.176906 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:22.189648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9bc38da5-0356-40de-b007-f8a0140dd0f6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.285746 May 23 18:08:22.190492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 42/75] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:21 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:22.312477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:22.320641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bca4bcd1-dcbd-4ab1-9b70-679eafa86a2f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.252675 May 23 18:08:22.321295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 34/76] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:22 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:22.799395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:22.801094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:22.815567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:22.816027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:22.816811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:22.817257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:22.980017 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:22.999965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:23.002300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:23.004776 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2cf6236b-e0c2-4aa3-8ad3-2e1d17ef82f0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.214152 May 23 18:08:23.020050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 43/77] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:22 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:23.031836 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:23.032596 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:23.040201 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:23.040743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:23.042375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:23.043014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:23.206456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:23.207105 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:23.211041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:23.214304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:23.214780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:23.221290 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a267cd44-ff8d-4532-898a-af1e3a28240d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.194527 May 23 18:08:23.222182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 35/78] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:23 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:23.223709 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:23.224328 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:23.244717 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:23.338577 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:23.339864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:23.350074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:23.351385 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:23.352904 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:23.353743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:23.396837 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:23.407100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0cfaadec-2922-43f3-a254-38289d5d1644 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.204278 May 23 18:08:23.408163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 44/79] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:23 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:23.505817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:23.515097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db4ac27a-f19e-41d0-bc1f-0c9941a5fcc5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.181464 May 23 18:08:23.516996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 36/80] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:23 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:24.038641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:24.040891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:24.053842 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.054687 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.055646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.056225 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.128359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-63bda6e0-1cf3-4f8a-b0d0-93346eda7f8b req-4875493f-8007-43f2-b38d-437457932700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f341e2-47cb-4c4a-a410-2f4305c01382", "name": "network-vif-plugged", "status": "completed", "tag": "22e29b49-5f40-406f-b061-b06a7907af74"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:24.137587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-63bda6e0-1cf3-4f8a-b0d0-93346eda7f8b req-4875493f-8007-43f2-b38d-437457932700 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.137986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-63bda6e0-1cf3-4f8a-b0d0-93346eda7f8b req-4875493f-8007-43f2-b38d-437457932700 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.152661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-63bda6e0-1cf3-4f8a-b0d0-93346eda7f8b req-4875493f-8007-43f2-b38d-437457932700 service nova] Creating event network-vif-plugged:22e29b49-5f40-406f-b061-b06a7907af74 for instance 99f341e2-47cb-4c4a-a410-2f4305c01382 on hv-cinder-75078 May 23 18:08:24.158770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-63bda6e0-1cf3-4f8a-b0d0-93346eda7f8b req-4875493f-8007-43f2-b38d-437457932700 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136233 May 23 18:08:24.159845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 37/81] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:24.241643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:24.242942 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:24.254409 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.254954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.256012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.256883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.295339 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:24.306832 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:24.319972 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:24.324871 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-28157622-8f77-43ba-a9e6-df0e06ca9cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.303156 May 23 18:08:24.325488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 45/82] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:24 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:24.429972 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:24.431714 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:24.441423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.442232 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.443501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.444243 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.449190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:24.459010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a0e5c8d-a8f4-45d2-85ae-06f24939d7e4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.224560 May 23 18:08:24.463338 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 38/83] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:24 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:24.536588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:24.537333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:24.552471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.553819 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.558000 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:24.559280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:24.766664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:24.774500 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b0dd357-2ac3-4a27-ba8b-c1ee24ccdc71 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.353306 May 23 18:08:24.775122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 46/84] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:24 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:24.878503 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:25.040727 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:25.050066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67a1b6ef-8cde-4f9c-8911-78bf0aeb07f1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.519201 May 23 18:08:25.050642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 39/85] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:24 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:25.335643 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-55d0d9da-ffa6-43b0-bbcd-b5bfc2aa8e00 req-43f22194-ddd5-4a7c-a821-ddae60fe94e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03538a0b-c9de-4f9a-826d-72679e1fde88", "tag": "18232278-cf4a-4600-a0ef-598db447288f"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:25.346188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:25.347069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:25.356803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-55d0d9da-ffa6-43b0-bbcd-b5bfc2aa8e00 req-43f22194-ddd5-4a7c-a821-ddae60fe94e9 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:25.358981 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:25.360842 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-55d0d9da-ffa6-43b0-bbcd-b5bfc2aa8e00 req-43f22194-ddd5-4a7c-a821-ddae60fe94e9 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:25.360983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:25.363486 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:25.364543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:25.388021 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-55d0d9da-ffa6-43b0-bbcd-b5bfc2aa8e00 req-43f22194-ddd5-4a7c-a821-ddae60fe94e9 service nova] Creating event network-changed:18232278-cf4a-4600-a0ef-598db447288f for instance 03538a0b-c9de-4f9a-826d-72679e1fde88 on hv-cinder-75078 May 23 18:08:25.406812 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-55d0d9da-ffa6-43b0-bbcd-b5bfc2aa8e00 req-43f22194-ddd5-4a7c-a821-ddae60fe94e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076766 May 23 18:08:25.409667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 47/86] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:25.476369 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:25.477079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:25.492137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:25.492588 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:25.493404 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:25.494008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:25.759501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:25.771400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bec3b801-f5a5-46bc-8a59-a6b134b8c88f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.298919 May 23 18:08:25.772131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 48/87] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:25 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:25.793460 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:25.795297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:25.807294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:25.807862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:25.808875 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:25.809396 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:25.958256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:26.005707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:26.013675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:26.014112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:26.018070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0bc50ce5-49f1-4bce-8efa-59cb30132c69 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.678060 May 23 18:08:26.022133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 40/88] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:25 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:26.048238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:26.069163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:26.069840 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:26.081860 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:26.084410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:26.087668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:26.089698 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:26.194408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:26.223559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-43b435e4-70e8-4c58-972a-4d480386085b tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.435318 May 23 18:08:26.224151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 49/89] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:25 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:26.262403 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=10 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:26.377229 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-415d8fb2-551a-4e9b-8e87-97c5f87d7816 req-fa9bfd4b-35f3-4237-a6ae-0a928f254605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebec7dc8-9547-4dac-9035-078304c6793c", "tag": "8a5c394c-2439-4849-a7b4-278598a8a204"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:26.389549 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-415d8fb2-551a-4e9b-8e87-97c5f87d7816 req-fa9bfd4b-35f3-4237-a6ae-0a928f254605 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:26.389988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-415d8fb2-551a-4e9b-8e87-97c5f87d7816 req-fa9bfd4b-35f3-4237-a6ae-0a928f254605 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:26.436418 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:26.449549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-237b6073-3ff1-4e5b-b185-51a96e0b7228 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.385149 May 23 18:08:26.450325 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 41/90] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:26 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:26.451951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-415d8fb2-551a-4e9b-8e87-97c5f87d7816 req-fa9bfd4b-35f3-4237-a6ae-0a928f254605 service nova] Creating event network-changed:8a5c394c-2439-4849-a7b4-278598a8a204 for instance ebec7dc8-9547-4dac-9035-078304c6793c on hv-cinder-75078 May 23 18:08:26.470931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-415d8fb2-551a-4e9b-8e87-97c5f87d7816 req-fa9bfd4b-35f3-4237-a6ae-0a928f254605 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095853 May 23 18:08:26.474123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 50/91] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:26.788182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:26.789028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:26.800995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:26.808481 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:26.809338 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:26.809781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:26.815225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:27.039697 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:27.041335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:27.056549 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:27.057015 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:27.057765 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:27.058204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:27.112241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:27.128624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b46d672-94b7-42b1-aa6d-92c72c92de4c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.344499 May 23 18:08:27.129790 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 42/92] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:26 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:27.245943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:27.247407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:27.259620 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:27.260239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:27.261370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:27.261955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:27.379758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:27.389385 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:27.398307 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:27.401218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4d67a734-fa7a-434c-8c3b-04f92abfcd4a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.366387 May 23 18:08:27.402834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 51/93] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:27 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:27.467238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:27.467859 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:27.476663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:27.477104 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:27.478175 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:27.478776 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:27.654858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:27.664710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bde3c1e4-5d9b-4e7a-bdd5-f126645aa4d0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.428209 May 23 18:08:27.665348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 43/94] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:27 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:27.774786 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:27.787834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3e4434ec-6cac-41c2-ad20-f0241a7e8e73 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.325236 May 23 18:08:27.790094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 52/95] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:27 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:27.827708 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-65622ebb-8732-4469-abb4-13cbff89c8c4 req-4f0c2612-63e3-46cd-a452-da11d625af11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7f7689-8026-4116-b605-567d3ad605b1", "name": "network-vif-plugged", "status": "completed", "tag": "24192180-2c11-45fa-bcc6-613fdc478a7a"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:27.844041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-65622ebb-8732-4469-abb4-13cbff89c8c4 req-4f0c2612-63e3-46cd-a452-da11d625af11 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:27.844544 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-65622ebb-8732-4469-abb4-13cbff89c8c4 req-4f0c2612-63e3-46cd-a452-da11d625af11 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:27.874376 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-65622ebb-8732-4469-abb4-13cbff89c8c4 req-4f0c2612-63e3-46cd-a452-da11d625af11 service nova] Creating event network-vif-plugged:24192180-2c11-45fa-bcc6-613fdc478a7a for instance 7a7f7689-8026-4116-b605-567d3ad605b1 on hv-cinder-75078 May 23 18:08:27.885832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-65622ebb-8732-4469-abb4-13cbff89c8c4 req-4f0c2612-63e3-46cd-a452-da11d625af11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062952 May 23 18:08:27.889681 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 44/96] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:08:28.148814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:28.149654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:28.157049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.157879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:28.158830 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.159410 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:28.392214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:28.419843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a4e94271-de96-44ba-b5d0-b36617bf62a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.276058 May 23 18:08:28.423438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 53/97] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:28 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:28.442190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:28.443119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:28.471094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.473499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:28.477371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.479248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:28.681465 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:28.682138 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:28.696376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.696823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:28.697602 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.698039 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:28.771595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:28.781089 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:28.783166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:28.784289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ac248c41-81b9-4540-a5db-dd68221ecea7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.363919 May 23 18:08:28.784852 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 45/98] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:28 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:28.813656 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:28.814287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:28.824467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.825239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:28.826640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:28.828059 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:29.064247 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:29.074489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-14bf4847-110f-4a10-af9a-6fdd72a5eb6e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.270284 May 23 18:08:29.074489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 46/99] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:28 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:29.143868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:29.157080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e429616e-4476-4949-ae28-7fa6896c506d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.478744 May 23 18:08:29.157756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 54/100] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:28 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:29.439691 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:29.440293 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:29.446128 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:29.446573 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:29.447422 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:29.447779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:29.598054 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:29.617002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c944d288-e7a8-4240-8f5e-0caee3ff3e52 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.181713 May 23 18:08:29.618103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 47/101] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:29 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:29.803062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:29.803667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:29.810753 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:29.811203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:29.811957 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:29.812387 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:29.965447 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:29.973445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:29.974973 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:29.976069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae0c943e-a14f-4ce2-b93a-9e7bdad1ca4b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.177122 May 23 18:08:29.976637 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 55/102] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:29 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:30.092112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:30.093261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:30.100068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:30.100529 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:30.101321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:30.101759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:30.178137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:30.179046 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:30.186001 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:30.186748 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:30.187936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:30.188612 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:30.247339 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:30.264791 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-753e9b88-9286-484d-9239-720bf5426f15 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.176462 May 23 18:08:30.264987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 48/103] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:30 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:30.363402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:30.373184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca478b77-49e0-452f-8120-8aaa9b939c65 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.199238 May 23 18:08:30.374055 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 56/104] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:30 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:30.634619 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:30.635286 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:30.641798 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:30.642242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:30.643025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:30.643460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:30.780107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:30.788482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b3f68f11-c78e-4b6b-a1fd-69d88ca8b1b7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.157837 May 23 18:08:30.797712 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 49/105] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:30 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:30.994443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:30.995084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:31.001823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.002273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.003068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.003505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.146666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:31.154645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:31.156215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:31.157510 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b5c1df24-acb2-4a8a-9419-09a7f940bef8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.166863 May 23 18:08:31.158101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 57/106] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:30 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:08:31.281195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:31.281932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:31.288222 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.288668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.289424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.289854 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.391852 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:31.392615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:31.399331 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.399779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.400540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.400967 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.428086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:31.435660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-801ef735-b2a4-469d-9dbf-adc2b203860c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.158228 May 23 18:08:31.436261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 50/107] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:31 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:31.536256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:31.544879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e5c61852-947d-4178-ad87-1ba5bcf00be6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.158366 May 23 18:08:31.545450 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 58/108] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:31 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:31.804813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:31.805429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:31.811571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.811955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.813437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:31.813887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:31.945585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:31.953724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-873e0749-ff34-474b-99fc-61ec23ef64b5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.152392 May 23 18:08:31.954293 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 51/109] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:31 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:32.176267 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:32.176902 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:32.182906 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.183349 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:32.184099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.184529 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:32.313647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:32.323086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:32.324895 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:32.326030 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-741070e3-af93-40ad-a845-dd929f50017c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.154487 May 23 18:08:32.326581 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 59/110] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:32 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:32.452733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:32.453376 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:32.459512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.459954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:32.460700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.461129 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:32.562793 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:32.563414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:32.569475 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.569927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:32.570717 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.571156 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:32.591581 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:32.599773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d8df3c17-5fae-42e3-bf12-a5cc13da4443 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.150921 May 23 18:08:32.600333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 52/111] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:32 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:32.700716 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:32.708742 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bffbd410-9c57-4f77-aa82-2406e47def73 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.149789 May 23 18:08:32.709236 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 60/112] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:32 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:32.971756 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:32.972371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:32.978532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.979249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:32.979749 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:32.980216 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:33.104099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:33.111692 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3c80eae8-73c2-4509-b354-16cf88a734ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.145165 May 23 18:08:33.112255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 53/113] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:32 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:33.344253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:33.344858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:33.350920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:33.351361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:33.352114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:33.352545 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:33.477607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:33.485990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:33.487514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:33.488604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-820b3727-e85e-46b7-9d65-cf00fc5e5d10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.148347 May 23 18:08:33.489165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 61/114] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:33 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:33.616151 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:33.616677 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:33.622634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:33.623097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:33.623863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:33.624296 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:33.725730 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:33.726631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:33.732710 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:33.733723 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:33.734039 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:33.735333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:33.752148 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:33.757936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:33.765318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fb153fa6-f078-48d9-b0be-cd4d21973a36 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.153092 May 23 18:08:33.765954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 54/115] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:33 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:33.868856 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:33.876615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-73e6fbdc-61f4-42cd-b538-4994a5471aa6 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.154718 May 23 18:08:33.877023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 62/116] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:33 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:34.128527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:34.129060 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:34.135700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.136141 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.136890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.137318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.268835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:34.276428 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-18529b03-aeca-490b-8bc2-300a1e9af236 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.152301 May 23 18:08:34.277011 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 55/117] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:34 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:34.505468 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:34.506075 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:34.512403 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.512847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.513602 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.514035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.639974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:34.648453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:34.649955 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:34.651079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a1efa2fe-b2b3-45f4-b18c-3ed82c7643a5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.149458 May 23 18:08:34.651632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 63/118] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:34 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:34.783182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:34.783781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:34.789794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.790247 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.791022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.791454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.894561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:34.895145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:34.901102 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.901550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.902356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:34.902823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:34.926074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:34.934796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a4276fa1-b0c2-4abc-86ef-adc7273cd190 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.155741 May 23 18:08:34.935622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 56/119] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:34 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:35.043078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:35.051504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4bd64531-3f74-4f04-8e89-80bf12e3b0ea tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.161882 May 23 18:08:35.052250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 64/120] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:34 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:35.295477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:35.296520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:35.304345 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:35.304792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:35.305555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:35.305988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:35.438583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:35.445992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8cf1c3d6-11c9-42d1-a5ae-77ccd30feb7d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.156071 May 23 18:08:35.446560 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 57/121] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:35 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:35.670888 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:35.670888 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:35.676759 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:35.677425 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:35.678961 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:35.679576 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:35.746733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-bcc7feb8-d160-426f-bf01-faff8d8ccd60 req-80de2ed6-9620-41cd-a354-4bff44ac3c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb843a05-dbd1-4fbf-94a9-1dff354593f0", "name": "network-vif-plugged", "status": "completed", "tag": "b9cadce7-4d82-436c-82ae-68af5f3a712a"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:35.767444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-bcc7feb8-d160-426f-bf01-faff8d8ccd60 req-80de2ed6-9620-41cd-a354-4bff44ac3c72 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:35.767893 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-bcc7feb8-d160-426f-bf01-faff8d8ccd60 req-80de2ed6-9620-41cd-a354-4bff44ac3c72 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:35.785095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-bcc7feb8-d160-426f-bf01-faff8d8ccd60 req-80de2ed6-9620-41cd-a354-4bff44ac3c72 service nova] Creating event network-vif-plugged:b9cadce7-4d82-436c-82ae-68af5f3a712a for instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 on hv-cinder-75078 May 23 18:08:35.793514 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-bcc7feb8-d160-426f-bf01-faff8d8ccd60 req-80de2ed6-9620-41cd-a354-4bff44ac3c72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051351 May 23 18:08:35.794290 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 58/122] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:35.837034 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:35.847249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:35.848795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:35.850113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b2f2426b-b251-456b-9b18-051376a533ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.185026 May 23 18:08:35.851184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 65/123] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:35 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:35.954289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:35.955162 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:35.962522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:35.963014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:35.963861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:35.964199 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:36.069620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:36.069767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:36.075907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:36.076480 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:36.077258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:36.077686 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:36.106435 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:36.119805 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ca04e5f7-3eb3-4d6c-821c-928caa9fb638 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.171117 May 23 18:08:36.120831 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 59/124] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:35 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:36.229819 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:36.238193 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-efae8a24-f59c-4683-b018-86de3ac9bc09 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.173131 May 23 18:08:36.239065 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 66/125] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:36 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:36.462059 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:36.462690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:36.470557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:36.471046 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:36.471819 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:36.472255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:36.476482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:36.652919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:36.662167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5271698-5fd4-48b3-b761-964baf84c7ac tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.203784 May 23 18:08:36.663007 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 60/126] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:36 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:36.869507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:36.870320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:36.880519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:36.881020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:36.882310 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:36.883184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:37.027168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:37.035800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:37.037300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:37.038406 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b4c48786-d06c-45ff-8ac9-166107d11c9f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.173469 May 23 18:08:37.039002 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 67/127] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:36 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:37.137997 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:37.138676 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:37.145717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:37.146233 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:37.147083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:37.147582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:37.256805 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:37.257884 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:37.259692 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:37.265143 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:37.265849 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:37.267482 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:37.267482 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:37.288259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:37.302258 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-474e3c3e-3f07-45b1-bb81-3fad93f9631c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.168207 May 23 18:08:37.303053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 61/128] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:37 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:37.416062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:37.424297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a8a6b1f7-37ca-4db4-bedf-dd26bbd4e33a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.171735 May 23 18:08:37.424878 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 68/129] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:37 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:37.679237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:37.679970 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:37.681859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:37.687152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:37.687600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:37.688346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:37.688773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:37.836337 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:37.847374 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ee82569d-b9d5-425f-a993-949dba98fc6d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.172191 May 23 18:08:37.847965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 62/130] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:37 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:38.055251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:38.055863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:38.062046 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.062889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:38.063347 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.063764 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:38.205825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:38.214460 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:38.215994 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:38.217084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f32c02d0-a0eb-4de9-81b2-bd0d49d170e2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.165655 May 23 18:08:38.217674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 69/131] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:38 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:38.319448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:38.320155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:38.326153 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.326717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:38.327590 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.328678 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:38.443768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:38.445035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:38.454825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.455436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:38.456328 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.456925 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:38.464252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:38.474121 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-28dea0d5-efa4-4db8-bb4b-749872afac53 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.158460 May 23 18:08:38.474729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 63/132] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:38 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:38.600026 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:38.607873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e65ec41e-dcbd-4e52-a322-96746abe8b48 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.170430 May 23 18:08:38.608448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 70/133] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:38 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:38.863762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:38.864304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:38.870273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.870760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:38.871528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:38.871960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:39.000861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:39.009692 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-11e45940-2958-43ea-bfe5-8a754830daeb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.150384 May 23 18:08:39.010273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 64/134] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:38 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:39.236502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:39.237099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:39.243074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:39.243508 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:39.244254 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:39.244676 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:39.372553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:39.380583 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:39.382066 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:39.383424 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c53a2b8-5120-46b3-b66e-52966e5e1180 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.151559 May 23 18:08:39.383982 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 71/135] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:39 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:39.490826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:39.491307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:39.497536 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:39.497976 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:39.498735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:39.499164 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:39.624831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:39.625806 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:39.633998 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:39.636035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:39.636840 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:39.637283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:39.637817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:39.648583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bcaa9615-1f4a-47d9-b3af-cb5f7bfa7545 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.161493 May 23 18:08:39.652892 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 65/136] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:39 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:39.785372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:39.792642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-920778c3-6cdb-4753-b2a1-0f4ddc1d0366 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.171719 May 23 18:08:39.793196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 72/137] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:39 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:40.026582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:40.027248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:40.033678 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.034116 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.034928 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.035356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.167845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:40.175351 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6f01a48e-5c45-427a-a30e-f47097557b13 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.152588 May 23 18:08:40.175924 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 66/138] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:40 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:40.401416 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:40.402019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:40.408033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.408483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.409240 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.409673 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.537224 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:40.545061 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:40.547110 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:40.548209 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-29bef07a-2561-4640-ae73-7eef5202672b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.150692 May 23 18:08:40.548766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 73/139] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:40 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:40.666343 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:40.666974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:40.673792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.674230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.675016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.675443 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.800543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:40.807996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a22b3ac2-7329-4478-a1d9-b568a1b8aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.145460 May 23 18:08:40.808561 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 67/140] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:40 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:40.809122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:40.809731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:40.815672 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.816119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.816869 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:40.817300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:40.949563 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:40.957495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-77b615a0-4909-4167-94d1-a16648141386 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.152142 May 23 18:08:40.958058 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 74/141] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:40 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:41.191622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:41.192254 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:41.198173 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.198614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.199387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.199811 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.341617 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:41.349212 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2799ef11-cc9f-4e56-87da-be2bb543cc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.161469 May 23 18:08:41.349770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 68/142] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:41 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:41.566578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:41.567212 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:41.573201 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.573644 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.574386 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.574846 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.708819 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:41.716672 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:41.718170 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:41.719306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8eb293ce-091a-44a5-916b-bf4bdcc1b690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.157309 May 23 18:08:41.720182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 75/143] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:41 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:41.824439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:41.824983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:41.831055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.831501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.832248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.832678 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.974069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:41.974674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:41.980803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.981314 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.982225 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:41.982739 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:41.991531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:41.999763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6958f352-f6c9-45cb-a7ed-5f16a5845774 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.179206 May 23 18:08:42.002732 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 69/144] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:41 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:42.138844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:42.148787 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca2b0759-131d-4648-acaa-885c161f4d50 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.179225 May 23 18:08:42.149643 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 76/145] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:41 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:42.367703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:42.368273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:42.374441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:42.374930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:42.375733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:42.376171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:42.534637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:42.542192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eeb0f072-0c13-4a7a-965c-02da7cf6ecb8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.179602 May 23 18:08:42.542780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 70/146] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:42 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:42.737520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:42.738103 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:42.744126 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:42.744569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:42.745322 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:42.745751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:42.875066 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:42.883667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:42.885168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:42.886268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5106ec95-6c6d-4a1c-9215-30eec14e4289 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.152898 May 23 18:08:42.886855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 77/147] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:42 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:43.023990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:43.024627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:43.030789 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.031235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.032253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.032510 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.160619 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:43.166321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:43.166992 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:43.169767 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a18a6b6e-ecd1-419d-bdbd-a6bf3bd73cf5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.149547 May 23 18:08:43.170342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 71/148] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:43 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:43.174074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.174521 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.175307 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.175761 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.316334 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:43.325287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d65b1df7-24e2-40b8-ad3d-b4add651d62d tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.162718 May 23 18:08:43.325879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 78/149] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:43 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:43.559362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:43.559977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:43.566038 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.566477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.567261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.567690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.717158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:43.725046 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b0bbbfa-671d-40c6-9398-d2d01841500b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.169630 May 23 18:08:43.725609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 72/150] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:43 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:43.905582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:43.906180 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:43.912886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.913335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.914111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:43.914533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:43.918409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:44.074782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:44.083427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:44.084965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:44.086087 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2f593ac5-6894-49bf-8ddc-17e7ad1b24d8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.184339 May 23 18:08:44.086626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 79/151] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:43 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:08:44.189846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:44.190452 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:44.196520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:44.196942 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:44.197686 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:44.198113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:44.344153 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:44.345218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:44.347019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:44.350953 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:44.351623 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:44.352401 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:44.352831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:44.356679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3015cb58-06a7-44b5-b547-d342779137f5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.170579 May 23 18:08:44.357498 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 73/152] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:44 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:44.492914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:44.501784 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d60ec7fa-bbd2-4c85-93ca-60b8ab097eb1 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.161534 May 23 18:08:44.502354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 80/153] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:44 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:44.741885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:44.742491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:44.748488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:44.748929 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:44.749679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:44.750112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:45.017654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:45.025537 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fdb2a844-a7ba-46b7-88da-5c1f993d0905 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.287475 May 23 18:08:45.026107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 74/154] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:44 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:45.104832 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:45.105443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:45.112770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:45.113164 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:45.113858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:45.114285 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:45.247181 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:45.256185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:45.257929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:45.259053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-50ce4521-ceaa-4747-8bb6-fb0f3d99082c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.158643 May 23 18:08:45.259612 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 81/155] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:45 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:45.373513 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:45.374115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:45.380570 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:45.381022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:45.381779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:45.382215 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:45.523456 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:45.526431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:45.527067 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:45.533916 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:45.534321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:45.535333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:45.535770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:45.536769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a49bd158-af5d-47f0-abc6-8e807ce86ef4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.167066 May 23 18:08:45.537505 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 75/156] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:45 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:45.696587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:45.704251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba209b86-6dc0-448b-a250-512ec72f41a7 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.187366 May 23 18:08:45.705031 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 82/157] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:45 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:46.041411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:46.042021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:46.048048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.048493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.049269 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.049684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.187834 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:46.192795 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:46.199140 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6bf3917c-5fb0-4efa-9971-38b2ce454dc1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.161712 May 23 18:08:46.199861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 76/158] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:46 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:46.278463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:46.280799 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:46.292242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.292634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.293408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.294402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.439691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:46.447692 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:46.449186 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:46.450286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2e5cb634-e41d-4b2b-b997-be75e0253d0e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.176393 May 23 18:08:46.450873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 83/159] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:46 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:46.554048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:46.555272 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:46.561302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.561754 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.562511 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.563661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.710945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:46.719426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3cc3886b-b193-4ae5-b559-bed55731ac1a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.169209 May 23 18:08:46.720301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 77/160] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:46 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:46.724027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:46.724628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:46.735878 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.736362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.737152 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:46.737576 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:46.893147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:46.900850 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e1fd8269-2390-4235-8cf3-8bb3ea6522bc tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.183143 May 23 18:08:46.901883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 84/161] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:46 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:47.217083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:47.217689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:47.225784 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.226230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:47.227018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.227445 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:47.384499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:47.393142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83ff0dff-f517-4f1b-8c9e-03b7ddae9f42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.179997 May 23 18:08:47.393716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 78/162] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:47 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:47.471804 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:47.472503 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:47.481676 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.482451 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:47.483823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.484665 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:47.617630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:47.625509 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:47.627073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:47.628175 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-84cfdebd-1b94-4056-968b-b21e53f55942 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.162483 May 23 18:08:47.628744 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 85/163] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:47 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:47.737217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:47.737828 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:47.743665 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.744106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:47.744898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.745280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:47.879094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:47.886880 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-13618e28-a889-4567-935c-813c4226cace tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.153543 May 23 18:08:47.887440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 79/164] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:47 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:47.918657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:47.919282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:47.925752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.926196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:47.926969 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:47.927564 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:48.058509 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:48.066107 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-98ed1620-8499-4085-b9ac-a2c910ebc3ed tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.151155 May 23 18:08:48.066675 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 86/165] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:47 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:48.409890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:48.410493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:48.416526 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:48.416962 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:48.417706 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:48.418130 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:48.633416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:48.647103 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:48.648251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:48.652874 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aed3fe3b-4ec1-460f-823b-6dcb70df6454 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.247376 May 23 18:08:48.653461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 80/166] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:48 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:48.657234 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:48.657935 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:48.659133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:48.659721 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:48.837493 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:48.847691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:48.849834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:48.851252 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f120363-f69e-4c34-922d-21a8c0e3d128 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.207721 May 23 18:08:48.861907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 87/167] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:48 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:08:48.903182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:48.904352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:48.910625 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:48.911109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:48.911871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:48.912299 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:49.043521 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:49.051585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-621f1df4-aca3-4d35-be64-0c83a1f2ff8e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.152190 May 23 18:08:49.052145 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 81/168] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:48 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:49.083032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:49.083735 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:49.089812 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:49.090257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:49.092822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:49.093264 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:49.409939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:49.417362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9aae9576-f180-4155-8eac-c64c13405033 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.338260 May 23 18:08:49.418427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 88/169] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:49 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:49.502774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-3ccb25e1-702f-4a7d-8a97-5ed4c11c0f49 req-8b796a06-c4ec-43c1-a445-b603e99314b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebec7dc8-9547-4dac-9035-078304c6793c", "name": "network-vif-plugged", "status": "completed", "tag": "8a5c394c-2439-4849-a7b4-278598a8a204"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:08:49.512976 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-3ccb25e1-702f-4a7d-8a97-5ed4c11c0f49 req-8b796a06-c4ec-43c1-a445-b603e99314b1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:49.513548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-3ccb25e1-702f-4a7d-8a97-5ed4c11c0f49 req-8b796a06-c4ec-43c1-a445-b603e99314b1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:49.527229 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-3ccb25e1-702f-4a7d-8a97-5ed4c11c0f49 req-8b796a06-c4ec-43c1-a445-b603e99314b1 service nova] Creating event network-vif-plugged:8a5c394c-2439-4849-a7b4-278598a8a204 for instance ebec7dc8-9547-4dac-9035-078304c6793c on hv-cinder-75078 May 23 18:08:49.533577 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-3ccb25e1-702f-4a7d-8a97-5ed4c11c0f49 req-8b796a06-c4ec-43c1-a445-b603e99314b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035775 May 23 18:08:49.534171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 82/170] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:08:49.669263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:49.670404 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:49.676525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:49.676966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:49.677716 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:49.678316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:49.813032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:49.820357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a89564c7-314a-4ae8-bc00-732d1321d55b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.154992 May 23 18:08:49.820919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 89/171] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:49 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:49.869705 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:49.870408 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:49.876560 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:49.877001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:49.877759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:49.878186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:50.009124 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:50.019605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:50.019605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:50.020515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8bfcee2a-8e9a-4d6a-8789-d4f4ae20b6d3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.154972 May 23 18:08:50.021052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 83/172] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:49 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:50.068277 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:50.068886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:50.077284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:50.077284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:50.077284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:50.077284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:50.211319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:50.222315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b303d210-52b2-423d-b008-c30a9a9736b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.157657 May 23 18:08:50.231908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 90/173] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:50 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:50.435162 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:50.435695 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:50.442636 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:50.443106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:50.443959 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:50.444438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:50.578961 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:50.586781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f9bbee53-1fd4-4f70-9ffc-3ee7ac28bd3a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.155528 May 23 18:08:50.587354 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 84/174] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:50 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:50.837364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:50.837969 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:50.844690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:50.845139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:50.845901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:50.846330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:51.004375 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:51.012277 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-01020290-bc7a-4b1e-a147-ef4b98d421ee tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.178728 May 23 18:08:51.012855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 91/175] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:50 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:51.042611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:51.043273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:51.052235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:51.052605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:51.053362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:51.054230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:51.193171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:51.201448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:51.203107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:51.204753 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c9ff6204-a6c3-44a5-b5e6-74e9583786d6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.170212 May 23 18:08:51.205315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 85/176] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:51 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:51.238982 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:51.239594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:51.245504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:51.245961 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:51.246783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:51.247228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:51.379430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:51.387557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9c3051a5-7f72-454a-8650-2c20f78769bd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.152355 May 23 18:08:51.388123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 92/177] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:51 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:51.604132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:51.604783 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:51.611692 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:51.612267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:51.613043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:51.613478 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:51.752976 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:51.761564 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d312dad9-5ef2-4d0c-878f-c659f0957a44 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.161422 May 23 18:08:51.762728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 86/178] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:51 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:52.028704 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:52.029843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:52.036366 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.036815 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.037574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.038003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.167320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:52.174832 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b70407b-a230-4071-88ec-72fc7ed746c3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.149929 May 23 18:08:52.175400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 93/179] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:52 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:52.223236 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:52.223851 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:52.229774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.230217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.231000 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.231433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.385952 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:52.394869 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:52.396501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:52.397488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4956d15d-be2b-4d89-b7c2-ecf80875c667 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.178827 May 23 18:08:52.398055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 87/180] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:52 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:52.406878 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:52.407938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:52.416120 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.416570 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.417375 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.417810 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.569473 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:52.577024 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9244b11-05ca-49ce-b7f0-248091fc6f45 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.175860 May 23 18:08:52.577592 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 94/181] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:52 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:08:52.779508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:52.780352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:52.787356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.788001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.789009 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:52.789559 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:52.928139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:52.935746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0651caa3-f09f-4bd3-8802-38b092212881 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.160529 May 23 18:08:52.936558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 88/182] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:52 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:53.191393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:53.192007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:53.197915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.198361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:53.199137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.199589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:53.324450 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:53.326627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:53.333040 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4443c61d-e8c9-4f70-897c-f0b7118f8e19 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.145604 May 23 18:08:53.333598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 95/183] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:53 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:53.415647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:53.416277 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:53.422410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.422887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:53.423660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.424065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:53.557801 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:53.565895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:53.567439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:53.568536 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6ced465-6374-4f69-8803-ab6ad45b340e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.156761 May 23 18:08:53.569088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 89/184] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:53 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:53.595365 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:53.595904 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:53.601988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.602433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:53.603281 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.603714 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:53.735484 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:53.743187 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08002034-4243-43fb-820f-3093dc00273b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.152313 May 23 18:08:53.743745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 96/185] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:53 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:53.953837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:53.954456 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:53.960479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.960923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:53.961679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:53.962113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:54.092041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:54.099490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10c0d993-df50-49aa-b886-0dabd60f533f tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.150128 May 23 18:08:54.100053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 90/186] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:53 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:54.349114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:54.349712 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:54.355914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:54.356355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:54.357087 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:54.357513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:54.483775 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:54.491918 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ab85b7c-f1d8-4b63-8afb-a50eff075b93 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.146628 May 23 18:08:54.492474 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 97/187] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:54 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:54.587117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:54.587714 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:54.594270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:54.594766 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:54.595434 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:54.595859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:54.720438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:54.728207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:54.729716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:54.730853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c04bca5e-325b-42e4-9d82-570452ea2060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.147568 May 23 18:08:54.731402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 91/188] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:54 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:54.760882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:54.761412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:54.767495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:54.767940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:54.768681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:54.769113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:54.896799 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:54.904212 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1085bca0-fbb4-4d36-b918-e918e959db05 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.147400 May 23 18:08:54.904767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 98/189] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:54 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:55.116388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:55.116919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:55.122958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.123399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:55.124150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.124579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:55.258393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:55.266423 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d1bde0b8-a554-417a-8056-ad15a4b75e05 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.153239 May 23 18:08:55.267021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 92/190] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:55 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:55.508396 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:55.509117 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:55.515207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.515720 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:55.516472 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.516897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:55.649006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:55.657185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-694c4c62-ebdb-4b55-b15e-53ba52bf005b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.152855 May 23 18:08:55.657884 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 99/191] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:55 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:55.748835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:55.749433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:55.758865 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.759606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:55.760774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.761218 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:55.893103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:55.901511 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:55.903016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:55.904133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a2741679-819c-4796-bd64-374a34b348ca tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.159217 May 23 18:08:55.904673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 93/192] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:55 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:55.921373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:55.922513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:55.928536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.928979 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:55.929726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:55.930150 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:56.064729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:56.072258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d84c04c1-30d6-4120-9e3c-917724f7f236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.154576 May 23 18:08:56.072821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 100/193] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:55 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:56.284277 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:56.285207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:56.291569 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:56.292012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:56.292769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:56.293196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:56.295825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:56.423997 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:56.431826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cdb162c7-fd07-4c83-b6f6-78214cad70d9 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.152720 May 23 18:08:56.432438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 94/194] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:56 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:56.674112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:56.674733 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:56.680784 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:56.681230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:56.681983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:56.682414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:56.813289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:56.820849 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8ef0b937-91cf-4eb7-a99e-4b2449885754 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.150775 May 23 18:08:56.821417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 101/195] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:56 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:56.921324 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:56.921992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:56.928118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:56.928573 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:56.929328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:56.929760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:57.055003 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:57.063806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:57.065256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:57.066371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-910ab806-cdfb-442d-9f66-5aee0e94aa35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.149053 May 23 18:08:57.066951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 95/196] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:56 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:57.089203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:57.089815 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:57.096200 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:57.096646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:57.097407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:57.097847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:57.228218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:57.236233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-74db53cc-ff0f-4287-93bf-50ca66513edc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.150894 May 23 18:08:57.236783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 102/197] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:57 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:57.450222 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:57.450858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:57.456978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:57.457425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:57.458188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:57.458622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:57.586126 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:57.593947 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fc545776-16eb-47d2-9965-9d7777a43483 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.148571 May 23 18:08:57.594733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 96/198] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:57 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:57.838141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:57.838647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:57.844831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:57.845448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:57.846329 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:57.846781 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:57.973228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:57.983178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2e747de1-0b2a-4e70-8ba1-a0aa1d196b9d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.148501 May 23 18:08:57.984713 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 103/199] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:57 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:58.083993 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:58.084589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:58.090563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:58.090977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:58.091725 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:58.092150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:58.218990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:58.226960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:58.228464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:58.229571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5cc785ff-0cba-41a5-9a69-e2bc8293b490 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.149446 May 23 18:08:58.230137 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 97/200] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:58 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:08:58.253505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:58.254116 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:58.260381 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:58.260827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:58.261581 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:58.262018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:58.391062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:58.398440 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-630af4a0-6b95-41be-be7e-375d7af43501 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.149396 May 23 18:08:58.399034 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 104/201] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:58 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:58.611069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:58.611673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:58.617741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:58.618083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:58.618853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:58.619283 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:58.744631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:58.751999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-73120dfa-7bb0-4288-b35c-cd92d2332bf2 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.145423 May 23 18:08:58.752555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 98/202] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:58 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:59.001370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:59.001975 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:59.008215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.008663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.009422 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.009854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.144630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:59.152081 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3e4a824f-9ab6-4e6a-a55f-3bf90c9094ef tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.154993 May 23 18:08:59.152640 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 105/203] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:58 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:59.247762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:59.248271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:59.255033 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.255480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.256232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.256662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.387029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:59.395264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:59.396773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:59.397874 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ec4141a1-ef50-4081-96b7-25d71a5b9846 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.154068 May 23 18:08:59.398458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 99/204] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:08:59 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:08:59.415614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:59.416223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:59.422933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.423505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.424320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.424797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.567969 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:59.575330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-96ac56c0-49b8-447e-93f6-e9222eb44775 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.163503 May 23 18:08:59.575890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 106/205] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:59 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:08:59.769048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:08:59.769571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:08:59.775670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.776149 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.776872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:08:59.777304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:08:59.906896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:08:59.914238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-da3a0c8c-45fd-4bbe-a98f-691260effb9e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1314 microversion: 2.1 time: 0.149282 May 23 18:08:59.914814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 100/206] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:08:59 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:00.169689 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:00.170294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:00.176478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.176921 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:00.177857 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.178415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:00.304311 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:00.311579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b39d6fe8-6e3d-4b9e-b190-8efb87d77311 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.146527 May 23 18:09:00.312142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 107/207] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:00 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:00.415881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:00.416518 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:00.423230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.423670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:00.424425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.424850 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:00.554974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:00.563454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:00.564966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:00.566101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7cc4f424-c091-4f1c-9757-8d0a0b028995 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.154307 May 23 18:09:00.566663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 101/208] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:00 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:00.591953 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:00.592659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:00.598495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.598965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:00.599710 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.600133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:00.728258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:00.735862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-32550c0d-3b5e-4bdd-886f-3439ef6aa9d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.147648 May 23 18:09:00.736411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 108/209] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:00 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:00.931733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:00.932358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:00.940001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.940485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:00.941357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:00.941790 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.091258 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:01.102727 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb3ddcbf-dbf4-43ed-b53c-285a2f1a778e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1502 microversion: 2.1 time: 0.174769 May 23 18:09:01.103548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 102/210] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:00 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:01.183251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-44b0961a-e93e-4d2c-bd14-1c818bf7d5b3 req-5d4b6b94-fd60-4ff7-991c-5682c88a10b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03538a0b-c9de-4f9a-826d-72679e1fde88", "name": "network-vif-plugged", "status": "completed", "tag": "18232278-cf4a-4600-a0ef-598db447288f"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:09:01.199813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-44b0961a-e93e-4d2c-bd14-1c818bf7d5b3 req-5d4b6b94-fd60-4ff7-991c-5682c88a10b3 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:01.200510 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-44b0961a-e93e-4d2c-bd14-1c818bf7d5b3 req-5d4b6b94-fd60-4ff7-991c-5682c88a10b3 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.213395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-44b0961a-e93e-4d2c-bd14-1c818bf7d5b3 req-5d4b6b94-fd60-4ff7-991c-5682c88a10b3 service nova] Creating event network-vif-plugged:18232278-cf4a-4600-a0ef-598db447288f for instance 03538a0b-c9de-4f9a-826d-72679e1fde88 on hv-cinder-75078 May 23 18:09:01.219365 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-44b0961a-e93e-4d2c-bd14-1c818bf7d5b3 req-5d4b6b94-fd60-4ff7-991c-5682c88a10b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039788 May 23 18:09:01.220517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 109/211] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:01.330579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:01.332130 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:01.339529 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:01.340069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.341002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:01.342112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.526287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:01.542746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa42f6cb-fc68-40b7-a870-eba83339aeed tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1322 microversion: 2.1 time: 0.218107 May 23 18:09:01.543529 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 103/212] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:01 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:01.584766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:01.585522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:01.591694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:01.592201 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.592949 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:01.593971 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.724547 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:01.732415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:01.733899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:01.735049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ae7207d-e996-4d4b-9f7d-886696638627 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.154765 May 23 18:09:01.735840 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 110/213] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:01 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:01.752989 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:01.753593 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:01.760035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:01.760482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.761238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:01.761659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:01.895062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:01.902240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-59e71319-d031-466e-81a0-4d2c056213bb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.153381 May 23 18:09:01.902821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 104/214] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:01 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:02.529244 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-05b52f7d-ef55-4a25-a837-d4a9e4a21d1e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f898a8f1-7e71-49f3-bef6-503d0cd6aa36"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:09:02.530333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-05b52f7d-ef55-4a25-a837-d4a9e4a21d1e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:02.536992 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b52f7d-ef55-4a25-a837-d4a9e4a21d1e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.537449 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b52f7d-ef55-4a25-a837-d4a9e4a21d1e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:02.538203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b52f7d-ef55-4a25-a837-d4a9e4a21d1e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.538631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b52f7d-ef55-4a25-a837-d4a9e4a21d1e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:02.560786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:02.561451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:02.578097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.578553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:02.579346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.579780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:02.761821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:02.770810 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b84993eb-39c4-4b87-b494-563e80256106 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1517 microversion: 2.1 time: 0.213849 May 23 18:09:02.771559 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 105/215] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:02 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:02.776814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:02.777652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:02.791146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.792017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:02.795220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.796221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:02.958257 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:02.966319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:02.968114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:02.969365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e62be5c-673c-4dd4-827d-6874e0566622 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.196894 May 23 18:09:02.969937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 106/216] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:02 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:02.982071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:09:02.983144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:02.989913 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.990367 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:02.991164 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:02.991601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:03.055771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lazy-loading 'flavor' on Instance uuid 7a7f7689-8026-4116-b605-567d3ad605b1 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:09:03.188312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-955dc64b-997d-481b-8d60-5031c69a4652 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1/action" status: 200 len: 32 microversion: 2.1 time: 0.215834 May 23 18:09:03.188934 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 107/217] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:09:02 2022] POST /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:09:03.195128 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:03.195958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:03.205583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:03.206825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:03.207971 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:03.208406 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:03.364247 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:03.366908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:03.373725 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b9a6300-fe35-4909-9a81-179b52c0bdcb tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.183316 May 23 18:09:03.374399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 108/218] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:03 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:03.379530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:03.380107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:03.387221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:03.387703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:03.388551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:03.388982 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:03.531822 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:03.539487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-80d7b032-aa4e-4cbe-aaec-18b353e00657 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.163535 May 23 18:09:03.540156 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 109/219] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:03 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:03.987696 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:03.988381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:03.994465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:03.995014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:03.995842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:03.996279 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:04.134012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:04.142887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:04.144473 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:04.145688 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-68a3f0cc-afc6-4fcb-b1bb-0e3250f517f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.161978 May 23 18:09:04.146352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 110/220] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:03 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:09:04.392824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:04.393436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:04.413985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:04.414446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:04.415286 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:04.415661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:04.587383 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:04.595824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5eb9e9f8-2c32-4537-bc76-b0c2f1d5eca5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.207260 May 23 18:09:04.596401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 111/221] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:04 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:04.601021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:04.601654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:04.603405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:04.609653 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:04.610234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:04.611062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:04.611503 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:04.738368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:04.745849 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f71f25d3-d535-4bad-a86d-265b72d68602 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.148485 May 23 18:09:04.746407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 112/222] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:04 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:05.164259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:05.164881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:05.170896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:05.171373 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:05.172357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:05.172790 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:05.303541 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:05.311603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:05.313656 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:05.314778 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cb213470-6235-4ac5-a2af-96bdcca20e80 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.154451 May 23 18:09:05.315341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 113/223] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:05 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:09:05.612722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:05.613346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:05.619432 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:05.619871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:05.620612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:05.621037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:05.752549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:05.760280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2143e8e6-349d-4348-b05f-67d02dd4e1fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.152255 May 23 18:09:05.760845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 114/224] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:05 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:05.765314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:05.765918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:05.771629 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:05.772072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:05.772823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:05.773256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:05.900411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:05.908320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ee0753b-eaae-4692-86c3-00acf13fc0ff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.146549 May 23 18:09:05.908880 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 115/225] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:05 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:06.333204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:06.333798 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:06.339834 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:06.340278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:06.341025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:06.341454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:06.469961 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:06.477727 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:06.479248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:06.480332 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6c4529f0-370e-493a-89aa-90655f9e150c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.151129 May 23 18:09:06.480888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 116/226] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:06 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:09:06.778268 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:06.778919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:06.785148 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:06.785613 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:06.786359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:06.786814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:06.922275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:06.929720 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-617db0ac-e54b-416f-9add-45e7b055dc55 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.155217 May 23 18:09:06.930274 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 117/227] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:06 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:06.934565 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:06.935177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:06.941395 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:06.941834 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:06.942577 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:06.943026 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:07.071588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:07.083480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-624abf3d-b4ef-45c2-9de5-ab3e744f6af2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.152158 May 23 18:09:07.085245 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 118/228] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:06 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:07.498457 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:07.499099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:07.505935 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:07.506379 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:07.507199 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:07.507889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:07.644198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:07.652041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:07.653582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:07.654609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a0d14b7b-fdf4-4295-bd98-852452b731f7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.160103 May 23 18:09:07.655191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 119/229] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:07 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:09:07.947802 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:07.948329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:07.954426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:07.954914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:07.955675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:07.956109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:08.094228 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:08.103388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-38bf79b6-106b-4619-ad4e-8483a00f6236 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.159492 May 23 18:09:08.104339 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 120/230] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:07 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:08.108574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:08.109219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:08.116317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:08.116896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:08.117704 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:08.118331 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:08.329086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:08.344258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-05b52f7d-ef55-4a25-a837-d4a9e4a21d1e tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "POST /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.818543 May 23 18:09:08.344951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 111/231] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:09:02 2022] POST /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382/os-volume_attachments => generated 194 bytes in 5821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:09:08.480811 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:08.490920 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d56bafce-3f06-407d-93c2-c0509ad51795 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.385908 May 23 18:09:08.501039 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 121/232] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:08 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:08.674718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:08.675873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:08.678111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=88 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:08.684820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:08.685287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:08.686045 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:08.687571 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:08.864550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:08.873230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:08.890962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:08.892455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-da6e149c-cae0-4888-accc-feb0e232b707 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.223621 May 23 18:09:08.893034 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 112/233] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:08 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:09:09.127026 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:09.127652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:09.135399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:09.135649 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:09.136414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:09.137017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:09.291627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:09.299278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-77d09845-423b-4d81-a379-87bd4f65aa85 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.177015 May 23 18:09:09.299932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 122/234] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:09 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:09.508815 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:09.509419 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:09.517366 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:09.517988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:09.518964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:09.519551 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:09.663518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:09.671174 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c455271e-3244-483c-8e81-eab0cef1dae1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.166360 May 23 18:09:09.671756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 113/235] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:09 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:09.914990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:09.915869 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:09.924320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:09.924843 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:09.925832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:09.926278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:10.056801 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:10.065195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:10.066717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:10.067845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a741d5a4-72df-4c7c-92b3-f26467035e0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.158263 May 23 18:09:10.068405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 123/236] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:09 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:10.316101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:10.316645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:10.323238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:10.323691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:10.324455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:10.324887 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:10.453488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:10.462353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b2391678-d936-446e-8395-461b0184a088 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.150213 May 23 18:09:10.462948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 114/237] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:10 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:10.687845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:10.688486 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:10.694502 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:10.694987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:10.695746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:10.696182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:11.001740 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:11.009485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-882b9f08-00f1-4327-80cb-ea92f5a9f013 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.326092 May 23 18:09:11.010043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 124/238] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:10 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:11.086039 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:11.086678 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:11.092839 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:11.093817 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:11.094728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:11.095160 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:11.225634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:11.233604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:11.235694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:11.236796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e2fa286f-a81e-48a6-a300-79dd91f1e3d1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.154721 May 23 18:09:11.237353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 115/239] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:11 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:11.479381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:11.479898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:11.486027 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:11.486469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:11.487243 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:11.487671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:11.502188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:11.613083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:11.620363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-59aed086-9a41-448c-b462-32745789e693 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.144921 May 23 18:09:11.620952 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 125/240] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:11 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:12.026245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:12.026947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:12.033602 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:12.034053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:12.034849 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:12.035280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:12.161719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:12.169136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-36476154-faf7-4e04-b3c4-0380a86572f2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.146737 May 23 18:09:12.169703 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 116/241] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:12 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:12.255357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:12.256004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:12.262517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:12.263007 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:12.263786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:12.264235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:12.392039 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:12.399713 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:12.401204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:12.402281 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-160789e1-8b83-46c9-b4d7-8b2258cac69d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.150940 May 23 18:09:12.402856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 126/242] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:12 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:12.637649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:12.638255 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:12.644297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:12.644737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:12.645492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:12.645929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:12.773249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:12.781234 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cde27f12-02c5-4f2d-8e10-ec6ddc8507de tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.146622 May 23 18:09:12.781738 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 117/243] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:12 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:13.188331 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:13.188932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:13.195005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:13.195447 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:13.196193 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:13.196619 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:13.322563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:13.330791 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-28446b6c-760f-493b-841b-c4833dba678e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.146497 May 23 18:09:13.331336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 127/244] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:13 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:13.419721 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:13.420325 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:13.426942 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:13.427388 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:13.428139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:13.428607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:13.557597 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:13.565540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:13.567073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:13.568174 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c96ec87-6547-45da-a2de-700a2d4a55f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.152316 May 23 18:09:13.568729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 118/245] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:13 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:13.798056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:13.798669 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:13.804715 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:13.805166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:13.805922 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:13.806357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:13.934515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:13.942955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e60ec88-ab1e-4ea0-9777-be52c5303ce2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.148952 May 23 18:09:13.943540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 128/246] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:13 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:14.348106 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:14.348713 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:14.354596 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:14.355072 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:14.355822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:14.356321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:14.483534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:14.491693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b095f4f3-5788-4544-92d8-36517093c56f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.148262 May 23 18:09:14.492356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 119/247] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:14 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:14.585735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:14.586330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:14.592312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:14.592753 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:14.593491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:14.593915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:14.724029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:14.731985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:14.733566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:14.734670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a762d812-aa06-4fba-a943-83b21736a1e3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.152764 May 23 18:09:14.735803 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 129/248] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:14 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:14.960098 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:14.960705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:14.967006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:14.967502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:14.968276 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:14.968747 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:15.159823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:15.168661 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f9d5752c-d088-49d1-a360-0d99035a53be tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1360 microversion: 2.1 time: 0.212411 May 23 18:09:15.169230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 120/249] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:14 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1360 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:15.509500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:15.510106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:15.517488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:15.518207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:15.523403 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:15.523403 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:15.659616 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:15.667112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c77777e8-f912-4312-bb5f-33532d41900f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.161706 May 23 18:09:15.667695 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 130/250] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:15 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:15.752249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:15.752883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:15.759659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:15.760107 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:15.760876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:15.761313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:16.120763 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:16.129088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:16.130598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:16.131790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0e6cdf4f-6c9a-4ad0-a894-8f3ae1f3c17e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.383497 May 23 18:09:16.132614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 121/251] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:15 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:16.185601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:16.186209 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:16.192866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:16.193321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:16.194085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:16.194522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:16.319672 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:16.327006 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5087e28c-4f91-423b-91c4-a1a5ed00bdf4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1545 microversion: 2.1 time: 0.145131 May 23 18:09:16.327569 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 131/252] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:16 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1545 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:16.343680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-20acbaaa-6b41-44ca-aa82-4e7c11178854 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:16.344207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-20acbaaa-6b41-44ca-aa82-4e7c11178854 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:16.350245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20acbaaa-6b41-44ca-aa82-4e7c11178854 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:16.350719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20acbaaa-6b41-44ca-aa82-4e7c11178854 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:16.351494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20acbaaa-6b41-44ca-aa82-4e7c11178854 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:16.351933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20acbaaa-6b41-44ca-aa82-4e7c11178854 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:16.428463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-20acbaaa-6b41-44ca-aa82-4e7c11178854 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088385 May 23 18:09:16.429063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 122/253] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:09:16 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:16.689441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:16.689953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:16.695807 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:16.696249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:16.697004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:16.697430 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:16.836634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:16.846888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cf4db91c-b8e3-451c-af55-6af413fd5d24 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.160250 May 23 18:09:16.846888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 132/254] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:16 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:17.150569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:17.151312 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:17.158380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:17.158864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:17.159625 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:17.160062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:17.369589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:17.378335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:17.379873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:17.380971 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e0534468-828d-4e10-aae8-c282989e58c4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.234896 May 23 18:09:17.381533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 123/255] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:17 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:17.815203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-7f403868-e63e-445c-9180-abe0f3fb0b63 req-57952d37-58af-4de1-b64d-c448af7939c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03538a0b-c9de-4f9a-826d-72679e1fde88", "tag": "18232278-cf4a-4600-a0ef-598db447288f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:09:17.823540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-7f403868-e63e-445c-9180-abe0f3fb0b63 req-57952d37-58af-4de1-b64d-c448af7939c4 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:17.823978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-7f403868-e63e-445c-9180-abe0f3fb0b63 req-57952d37-58af-4de1-b64d-c448af7939c4 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:17.834836 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-7f403868-e63e-445c-9180-abe0f3fb0b63 req-57952d37-58af-4de1-b64d-c448af7939c4 service nova] Creating event network-changed:18232278-cf4a-4600-a0ef-598db447288f for instance 03538a0b-c9de-4f9a-826d-72679e1fde88 on hv-cinder-75078 May 23 18:09:17.839797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-7f403868-e63e-445c-9180-abe0f3fb0b63 req-57952d37-58af-4de1-b64d-c448af7939c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029125 May 23 18:09:17.840375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 133/256] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:17.862722 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:17.863347 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:17.870036 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:17.870894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:17.871866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:17.872499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:18.010578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:18.018285 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-92f31dc2-3ffa-4f92-acc8-f543b78f826e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.160184 May 23 18:09:18.018883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 124/257] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:17 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:18.400440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:18.401134 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:18.408057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:18.408510 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:18.409278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:18.409712 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:18.542804 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:18.551958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:18.553471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:18.554589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b0043b75-243b-4033-bc4d-54b673f423f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.158458 May 23 18:09:18.555355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 134/258] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:18 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:09:19.035291 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:19.035899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:19.042261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:19.042725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:19.043469 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:19.043903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:19.178963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:19.186362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6deaa450-4c87-4f88-ad09-b651386d697b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.154828 May 23 18:09:19.186956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 125/259] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:19 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:19.572490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:19.573088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:19.579641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:19.580083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:19.580829 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:19.581253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:19.708082 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:19.715862 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:19.717350 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:19.718474 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b10a7c79-da74-4fca-90ca-6d44bfbc6656 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.149864 May 23 18:09:19.719256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 135/260] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:19 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:20.203684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:20.204203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:20.210542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:20.211024 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:20.211788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:20.212222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:20.338411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:20.346635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c4cfce3d-0b76-4864-bc2b-6b73ea333a01 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.147063 May 23 18:09:20.347216 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 126/261] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:20 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:20.737035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:20.737638 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:20.743624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:20.744065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:20.744817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:20.745244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:20.874485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:20.882684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:20.884214 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:20.885299 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b2a71108-72dc-4826-b6bd-66782cbea311 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1408 microversion: 2.20 time: 0.152706 May 23 18:09:20.885859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 136/262] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:20 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:21.367003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:21.368486 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:21.377231 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:21.378173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:21.379168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:21.379873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:21.530044 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:21.538360 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c713f592-b271-4ea3-974a-63ccbf6aeb09 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.178590 May 23 18:09:21.539020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 127/263] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:21 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:21.903962 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:21.904637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:21.910744 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:21.911214 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:21.911973 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:21.912406 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:22.091442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:22.099665 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:22.101294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:22.102510 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9022e370-499a-401c-a04a-0eb329ca86a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1599 microversion: 2.20 time: 0.202485 May 23 18:09:22.103101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 137/264] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:09:21 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1599 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:09:22.120744 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c05cb173-d885-4b37-8d80-7e8fc0b7476d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:22.121233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c05cb173-d885-4b37-8d80-7e8fc0b7476d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:22.127745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05cb173-d885-4b37-8d80-7e8fc0b7476d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:22.128186 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05cb173-d885-4b37-8d80-7e8fc0b7476d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:22.128937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05cb173-d885-4b37-8d80-7e8fc0b7476d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:22.129364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05cb173-d885-4b37-8d80-7e8fc0b7476d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:22.216283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c05cb173-d885-4b37-8d80-7e8fc0b7476d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099424 May 23 18:09:22.216943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 128/265] 10.222.0.30 () {60 vars in 1315 bytes} [Mon May 23 18:09:22 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:09:22.555634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:22.556239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:22.562120 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:22.563263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:22.564005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:22.564437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:22.704069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:22.711833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-915b1b79-7bcd-4178-8afe-02324cc9ae76 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.160423 May 23 18:09:22.712497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 138/266] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:22 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:23.505767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-28c072cb-8123-4370-a239-0e11188e6127 req-519e9d7a-d775-4bc5-bad5-74e99d744fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebec7dc8-9547-4dac-9035-078304c6793c", "tag": "8a5c394c-2439-4849-a7b4-278598a8a204"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:09:23.530200 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-28c072cb-8123-4370-a239-0e11188e6127 req-519e9d7a-d775-4bc5-bad5-74e99d744fe0 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:23.530758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-28c072cb-8123-4370-a239-0e11188e6127 req-519e9d7a-d775-4bc5-bad5-74e99d744fe0 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:23.537037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:23.545555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-28c072cb-8123-4370-a239-0e11188e6127 req-519e9d7a-d775-4bc5-bad5-74e99d744fe0 service nova] Creating event network-changed:8a5c394c-2439-4849-a7b4-278598a8a204 for instance ebec7dc8-9547-4dac-9035-078304c6793c on hv-cinder-75078 May 23 18:09:23.553361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-28c072cb-8123-4370-a239-0e11188e6127 req-519e9d7a-d775-4bc5-bad5-74e99d744fe0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054542 May 23 18:09:23.554172 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 129/267] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:23.729200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:23.730618 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:23.739410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:23.740266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:23.741425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:23.741919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:23.994620 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:24.019779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-abb76d85-9aeb-4c01-a48c-6a0815f1960a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.294652 May 23 18:09:24.033027 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 139/268] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:23 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:25.037973 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:25.038721 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:25.046684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:25.047304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:25.048383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:25.048732 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:25.212035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:25.222344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-78186423-0cf9-47b2-b92d-21425a3267d7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.188610 May 23 18:09:25.223383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 130/269] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:25 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:26.239315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:26.240132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:26.246494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:26.246993 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:26.248016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:26.249271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:26.427424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:26.434989 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d12399ed-f88b-497d-a365-4a43760907ce tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.199508 May 23 18:09:26.435590 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 140/270] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:26 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:27.452939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:27.453704 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:27.461319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:27.461774 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:27.462675 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:27.463310 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:27.605820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:27.614106 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1eb213ca-2e49-4a97-ac49-fd951ab36cff tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.165566 May 23 18:09:27.614672 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 131/271] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:27 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:28.630359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:28.630995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:28.637335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:28.637777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:28.638517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:28.638973 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:28.771534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:28.779768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-671c0b5e-29e0-4e46-9f1b-94770e120a0a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.153280 May 23 18:09:28.780283 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 141/272] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:28 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:29.797227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:29.798233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:29.804823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:29.805272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:29.806037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:29.806469 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:29.943472 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:29.951129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-309b9d06-513d-4d9e-aa8d-98d46dbe20a2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.158352 May 23 18:09:29.951702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 132/273] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:29 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:30.968082 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:30.968836 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:30.974825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:30.975282 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:30.976040 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:30.976478 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:31.107025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:31.109402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:31.116721 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-238bd4f2-a249-4fc5-9625-a9473ce53471 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.152429 May 23 18:09:31.117227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 142/274] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:30 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:31.820383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:31.820929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:31.827452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:31.828073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:31.830086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:31.830532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:31.861208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:09:31.957352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-290439b6-f9e3-43b2-89d0-851b99f5f9ac tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 204 len: 0 microversion: 2.1 time: 0.140527 May 23 18:09:31.958519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 133/275] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:09:31 2022] DELETE /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:09:31.966396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:31.967028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:31.973884 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:31.974482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:31.975110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:31.975540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:32.107012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:32.115267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5b252d4b-d836-45e7-b136-b630c2098f77 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1554 microversion: 2.1 time: 0.152615 May 23 18:09:32.115831 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 143/276] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:31 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:32.134069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:32.134797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:32.141648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:32.142035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:32.143090 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:32.143600 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:32.292981 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:32.302226 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bda3dfc5-2c5b-46c4-962c-56915304bc30 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.172613 May 23 18:09:32.303213 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 134/277] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:32 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:33.133268 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:33.134165 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:33.140567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:33.141016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:33.141988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:33.142419 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:33.298312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:33.306624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d87500cb-e19a-46f2-b485-ddbd08af4a58 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1554 microversion: 2.1 time: 0.178414 May 23 18:09:33.307236 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 144/278] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:33 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:33.320649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:33.321583 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:33.327822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:33.328284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:33.329118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:33.329507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:33.491892 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:33.500117 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c795d10-d828-4d27-bbb8-e07b95a3d791 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.183520 May 23 18:09:33.501083 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 135/279] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:33 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:34.323507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:34.324150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:34.331525 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:34.331948 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:34.332851 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:34.333143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:34.511311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:34.527377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:34.549077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de6f1ac8-515d-470d-bcd5-1d4b96206415 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1554 microversion: 2.1 time: 0.229310 May 23 18:09:34.549962 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 145/280] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:34 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:34.559219 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:34.572529 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:34.572991 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:34.573836 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:34.574292 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:34.844579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:34.852955 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3bac5448-ee4e-4f2b-a550-5283ad6505c7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.338471 May 23 18:09:34.853791 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 136/281] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:34 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:35.147364 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-3b16bdbc-95a4-4dfd-850b-010842df500a req-dc5d59cf-4560-438d-8e95-0f2372ee6074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f341e2-47cb-4c4a-a410-2f4305c01382", "name": "network-vif-deleted", "tag": "22e29b49-5f40-406f-b061-b06a7907af74"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:09:35.153128 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=68 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:35.159725 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-3b16bdbc-95a4-4dfd-850b-010842df500a req-dc5d59cf-4560-438d-8e95-0f2372ee6074 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:35.160434 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-3b16bdbc-95a4-4dfd-850b-010842df500a req-dc5d59cf-4560-438d-8e95-0f2372ee6074 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:35.174643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-3b16bdbc-95a4-4dfd-850b-010842df500a req-dc5d59cf-4560-438d-8e95-0f2372ee6074 service nova] Creating event network-vif-deleted:22e29b49-5f40-406f-b061-b06a7907af74 for instance 99f341e2-47cb-4c4a-a410-2f4305c01382 on hv-cinder-75078 May 23 18:09:35.180568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-3b16bdbc-95a4-4dfd-850b-010842df500a req-dc5d59cf-4560-438d-8e95-0f2372ee6074 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036731 May 23 18:09:35.182313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 146/282] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:35.573457 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:35.579061 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:35.600571 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:35.603788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:35.607437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:35.609173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:35.684063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:35.684914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:35.685537 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lazy-loading 'fault' on Instance uuid 99f341e2-47cb-4c4a-a410-2f4305c01382 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:09:35.746848 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38349aaa207c4703a18f512ad2f95196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e941f449f34bcaa50de8b5d87b9389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:35.755271 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2213a470-5b10-41c3-a2ce-13645f2dc9ec tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 200 len: 1350 microversion: 2.1 time: 0.193272 May 23 18:09:35.756047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 137/283] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:35 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 1350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:35.869942 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:35.870641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:35.878369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:35.879169 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:35.880167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:35.880900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:36.099492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:36.108853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-596ceb9c-1348-47ff-bb1d-56ea7ef514df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.242966 May 23 18:09:36.110449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 147/284] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:35 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:36.775706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:36.776333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:36.793920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:36.796073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:36.797493 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:36.797963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:36.816954 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] HTTP exception thrown: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Request method failure captured: May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 HTTP/1.1 May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii81uYItIyQThZyPYfXrNLsMqwv-OBG0aG11viilxtfOBZifVa9qXQQKpKf8hzqv_B6XvU1wA8MCRFt4zU6Z1jGdo3XaHRI-MGE-GTOzre-6C6ofuTkE8EaxqHiO4UU1p2X-nrZHILKjnRJmWdTdi86xUy5BHPD4UySTLHomZ2gBDzAk May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:09:36.822348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 38349aaa207c4703a18f512ad2f95196 May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:36.823654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '99f341e2-47cb-4c4a-a410-2f4305c01382'} May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:09:36.824348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:36.826215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:36.827560 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Returning 404 to user: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:09:36.827560 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b31cdb58-4a28-49c9-8bb5-9d66ebebc44a tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 404 len: 111 microversion: 2.1 time: 0.054172 May 23 18:09:36.827560 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 138/285] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:36 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:09:36.962171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:36.965935 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:36.984483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:36.985868 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:36.988381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:36.989234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:37.008949 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] HTTP exception thrown: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Request method failure captured: May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382/os-volume_attachments HTTP/1.1 May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii81uYItIyQThZyPYfXrNLsMqwv-OBG0aG11viilxtfOBZifVa9qXQQKpKf8hzqv_B6XvU1wA8MCRFt4zU6Z1jGdo3XaHRI-MGE-GTOzre-6C6ofuTkE8EaxqHiO4UU1p2X-nrZHILKjnRJmWdTdi86xUy5BHPD4UySTLHomZ2gBDzAk May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:09:37.024512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 38349aaa207c4703a18f512ad2f95196 May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:37.025992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '99f341e2-47cb-4c4a-a410-2f4305c01382'} May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:09:37.026906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:37.027990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:37.029043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Returning 404 to user: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:09:37.029043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d75d5073-19d8-4dda-934d-7dada05f63a0 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.069710 May 23 18:09:37.029043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 148/286] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:09:36 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:09:37.128284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:37.129068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:37.141712 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:37.146072 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:37.147304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:37.147915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:37.365976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:37.374779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-196cbd20-3fa0-4b30-94f9-07128931680b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.252125 May 23 18:09:37.375353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 139/287] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:37 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:38.393496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:38.394105 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:38.400196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:38.400821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:38.401593 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:38.402029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:38.566241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:38.573814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-be080c5d-dde0-4260-9563-16139839114b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.184609 May 23 18:09:38.574386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 149/288] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:38 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:39.591566 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:39.592196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:39.595845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:39.601165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:39.601608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:39.602359 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:39.602823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:39.734177 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:39.741533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c1a83575-068e-4c83-81e8-4b7025b6acfb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.153749 May 23 18:09:39.742088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 140/289] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:39 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:40.758602 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:40.759251 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:40.765985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:40.766422 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:40.767201 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:40.767634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:40.893802 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:40.901327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-09abf362-e2ae-480f-ac26-6bf9710310e8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.146852 May 23 18:09:40.901876 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 150/290] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:40 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:41.918114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:41.918739 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:41.925291 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:41.925741 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:41.926497 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:41.926959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:42.056372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:42.063936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5cc400f1-8322-4b54-8d0a-8e4fef7ddd21 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.149673 May 23 18:09:42.064500 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 141/291] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:41 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:43.080714 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:43.081319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:43.087447 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:43.087917 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:43.088668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:43.089098 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:43.219968 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:43.227514 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d4046a65-f2f4-4425-852a-52ca46309b55 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.150857 May 23 18:09:43.228068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 151/292] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:43 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:44.244317 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:44.244928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:44.252261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:44.252706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:44.253467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:44.253904 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:44.388376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:44.396618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7f9849ad-8271-4b38-9a74-736045237720 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.156050 May 23 18:09:44.397191 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 142/293] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:44 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:44.804621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:44.805553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:44.812465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:44.813196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:44.813963 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:44.814388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:44.833171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] HTTP exception thrown: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Request method failure captured: May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 HTTP/1.1 May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii81uYItIyQThZyPYfXrNLsMqwv-OBG0aG11viilxtfOBZifVa9qXQQKpKf8hzqv_B6XvU1wA8MCRFt4zU6Z1jGdo3XaHRI-MGE-GTOzre-6C6ofuTkE8EaxqHiO4UU1p2X-nrZHILKjnRJmWdTdi86xUy5BHPD4UySTLHomZ2gBDzAk May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:09:44.835439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 38349aaa207c4703a18f512ad2f95196 May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.836824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '99f341e2-47cb-4c4a-a410-2f4305c01382'} May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:09:44.837722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.839037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:44.841527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Returning 404 to user: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:09:44.842946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7d7e23d4-e348-47d0-8d30-fd5db3b0b034 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 404 len: 111 microversion: 2.1 time: 0.042105 May 23 18:09:44.843825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 152/294] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:09:44 2022] DELETE /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:09:44.852874 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:44.853485 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] [instance: 99f341e2-47cb-4c4a-a410-2f4305c01382] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:44.861407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:44.861857 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:44.866633 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:44.867351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] HTTP exception thrown: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Request method failure captured: May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 HTTP/1.1 May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii81uYItIyQThZyPYfXrNLsMqwv-OBG0aG11viilxtfOBZifVa9qXQQKpKf8hzqv_B6XvU1wA8MCRFt4zU6Z1jGdo3XaHRI-MGE-GTOzre-6C6ofuTkE8EaxqHiO4UU1p2X-nrZHILKjnRJmWdTdi86xUy5BHPD4UySTLHomZ2gBDzAk May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:09:44.912479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b3e941f449f34bcaa50de8b5d87b9389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: b3e941f449f34bcaa50de8b5d87b9389 May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-DeleteServersTestJSON-1915494912 May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 38349aaa207c4703a18f512ad2f95196 May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-DeleteServersTestJSON-1915494912-project May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.913938 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '99f341e2-47cb-4c4a-a410-2f4305c01382'} May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:09:44.914728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. May 23 18:09:44.916293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:09:44.917900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] Returning 404 to user: Instance 99f341e2-47cb-4c4a-a410-2f4305c01382 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:09:44.917900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ea2f7e8-8ec7-4f0f-a141-9a84143a36a4 tempest-DeleteServersTestJSON-1915494912 tempest-DeleteServersTestJSON-1915494912-project] 10.222.0.30 "GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382" status: 404 len: 111 microversion: 2.1 time: 0.061002 May 23 18:09:44.917900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 143/295] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:44 2022] GET /compute/v2.1/servers/99f341e2-47cb-4c4a-a410-2f4305c01382 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:09:45.413667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:45.414267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:45.422225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:45.422608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:45.423565 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:45.424005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:45.566751 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:45.575975 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b7df9a53-5c2a-4e75-9c3a-5893ce2e16fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.166213 May 23 18:09:45.576661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 153/296] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:45 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:46.594122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:46.595025 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:46.601659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:46.602119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:46.602922 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:46.603573 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:46.762195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:46.773430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-595b7257-c221-4d7d-ba81-2c48d373c02e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.183870 May 23 18:09:46.773934 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 144/297] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:46 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:47.434097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a73e3a8-bee1-47d6-a310-833ca7cdfefa tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Action: 'create', calling method: .version_select at 0x7f8c1c1c68b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2046990668", "metadata": {"Type": "work"}}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:09:47.767930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a73e3a8-bee1-47d6-a310-833ca7cdfefa tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.590171 May 23 18:09:47.768833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 154/298] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 18:09:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 592 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 18:09:47.782662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f09060cd-9a55-434c-a585-3265980bf383 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c32d940>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:47.794770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:47.795657 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:47.806418 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:47.807166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:47.809663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:47.810340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:47.849251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f09060cd-9a55-434c-a585-3265980bf383 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.073550 May 23 18:09:47.849822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 145/299] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:47 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:47.966623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:47.975146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d474d3cc-05ba-4081-addc-aac7db920572 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.185695 May 23 18:09:47.975703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 155/300] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:47 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:48.861816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bccb6548-8f64-4f7d-b279-5637a0ff83e3 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c1eaaf0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:48.914514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bccb6548-8f64-4f7d-b279-5637a0ff83e3 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.056986 May 23 18:09:48.915260 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 146/301] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:48 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:48.994507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:48.995152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:49.002071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:49.002527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:49.003367 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:49.003801 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:49.138248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:49.146342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db04ff67-c40b-4b90-be30-d7952e00d642 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.156558 May 23 18:09:49.151778 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 156/302] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:48 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:49.928736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d0f4c37-1c16-4495-97ff-1cc329c3e1e7 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c1e41f0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:49.982150 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d0f4c37-1c16-4495-97ff-1cc329c3e1e7 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.057936 May 23 18:09:49.982728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 147/303] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:49 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:50.163434 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:50.163964 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:50.169725 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:50.170168 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:50.170952 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:50.171614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:50.312565 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:50.320202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c07dd301-18c1-4d27-bc8b-b1209b8494a9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.160659 May 23 18:09:50.320856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 157/304] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:50 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:50.994553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5dce110f-ed63-4efd-b4af-52261195169e tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c32d3a0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:51.040930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5dce110f-ed63-4efd-b4af-52261195169e tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 354 microversion: 2.1 time: 0.050636 May 23 18:09:51.041492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 148/305] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:50 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:51.053421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-25a5c8b3-408d-4c3f-b769-bfa48dc69b5c tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c238940>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:51.102926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-25a5c8b3-408d-4c3f-b769-bfa48dc69b5c tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 354 microversion: 2.1 time: 0.053169 May 23 18:09:51.103578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 158/306] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:51 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:51.119863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d1c6ad5f-266d-451b-9a08-05749ab5c494 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c33d670>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:51.178192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d1c6ad5f-266d-451b-9a08-05749ab5c494 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 202 len: 0 microversion: 2.1 time: 0.062056 May 23 18:09:51.178762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 149/307] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:09:51 2022] DELETE /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:09:51.186483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8e7ccfff-6885-481a-8f5d-079d8a4715dd tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c21cc10>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:51.232938 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8e7ccfff-6885-481a-8f5d-079d8a4715dd tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.050085 May 23 18:09:51.234135 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 159/308] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:51 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:51.337179 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:51.337781 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:51.346549 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:51.347028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:51.347781 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:51.348214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:51.474039 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:51.476211 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:51.482900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8ef3e2e4-ce27-40e8-a241-e367b9bd68e7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.149518 May 23 18:09:51.483656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 150/309] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:51 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:52.245974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ae95f911-ba94-4e31-9dff-978de8ab4ac2 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c1c6160>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:52.295328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ae95f911-ba94-4e31-9dff-978de8ab4ac2 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.053119 May 23 18:09:52.296507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 160/310] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:52 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:52.500674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:52.501207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:52.508850 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:52.509305 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:52.510079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:52.510526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:52.640771 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:52.648355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7f25445e-5f9a-47cc-b0fa-750bb17ceca2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.152622 May 23 18:09:52.648932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 151/311] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:52 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:53.308543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30d5a1f3-b440-40da-9045-8bfd6adb1b74 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c1cce50>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:53.359021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30d5a1f3-b440-40da-9045-8bfd6adb1b74 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.054194 May 23 18:09:53.359591 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 161/312] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:53 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:53.665018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:53.665626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:53.672084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:53.672532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:53.673292 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:53.673731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:53.800780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:53.809075 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-17988fda-5f73-440f-8ac9-8b225b84bf66 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.147791 May 23 18:09:53.809627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 152/313] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:53 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:54.377012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7509590-ad81-433f-b8c8-24c9a847c373 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c238940>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:54.426204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7509590-ad81-433f-b8c8-24c9a847c373 tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.056045 May 23 18:09:54.426787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 162/314] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:54 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:54.826286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:54.827496 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:54.833933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:54.834378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:54.835184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:54.835615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:54.972408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:54.979850 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-33cf5c88-7200-44c2-bb82-2633979bd9af tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.157335 May 23 18:09:54.980408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 153/315] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:54 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:55.438779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04a3c684-57e9-4e90-a330-f7fad3be02ad tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c238f70>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:55.486623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04a3c684-57e9-4e90-a330-f7fad3be02ad tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 200 len: 353 microversion: 2.1 time: 0.052711 May 23 18:09:55.487251 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 163/316] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:55 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:09:55.998393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:56.001702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:56.011310 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:56.012728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:56.013615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:56.015752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:56.173395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:56.189750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-60d31fff-cf01-44e9-9154-683a24fdfee5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.195094 May 23 18:09:56.192431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 154/317] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:55 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:09:56.498773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df7a3089-02a7-4afb-b2c2-da31ccc79e1c tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Calling method '.version_select at 0x7f8c1c21cdc0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:56.526733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-df7a3089-02a7-4afb-b2c2-da31ccc79e1c tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] HTTP exception thrown: Volume 2fdd9132-5b6d-455c-8e92-375315fbdae4 could not be found. May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df7a3089-02a7-4afb-b2c2-da31ccc79e1c tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Request method failure captured: May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 HTTP/1.1 May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii83r9T32l2u7ppXxPz3g8TE0BokeGtP5hSfehgJhkFK0KWGBj2bXrJj3kE5wyj8F33qQMAuu_ThzLSvkGc6uV2medMY77LzkqCIbqWJ9VcZhMx3wHB464_EOdpfoqypXeRzdi_InYwQ3AEI62PopVRZIdWWNxOCtfUWpNswl0RUb2yc May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 4e53b5c27ff1492cba01bdb3ba6a60dc May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesGetTestJSON-1288781047 May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:09:56.528848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e53b5c27ff1492cba01bdb3ba6a60dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e53b5c27ff1492cba01bdb3ba6a60dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e53b5c27ff1492cba01bdb3ba6a60dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e53b5c27ff1492cba01bdb3ba6a60dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesGetTestJSON-1288781047 May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 4e53b5c27ff1492cba01bdb3ba6a60dc May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesGetTestJSON-1288781047 May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesGetTestJSON-1288781047-project May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 45f8798b1437441aa059236a21bdfd59 May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesGetTestJSON-1288781047-project May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Volume 2fdd9132-5b6d-455c-8e92-375315fbdae4 could not be found. May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '2fdd9132-5b6d-455c-8e92-375315fbdae4'} May 23 18:09:56.530945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fdd9132-5b6d-455c-8e92-375315fbdae4 could not be found. (HTTP 404) (Request-ID: req-a6fcccf5-32e0-445a-a1eb-659c819e9941) May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:56.532075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:09:56.533355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fdd9132-5b6d-455c-8e92-375315fbdae4 could not be found. May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 18:09:56.534642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fdd9132-5b6d-455c-8e92-375315fbdae4 could not be found. May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fdd9132-5b6d-455c-8e92-375315fbdae4 could not be found. May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df7a3089-02a7-4afb-b2c2-da31ccc79e1c tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] Returning 404 to user: Volume 2fdd9132-5b6d-455c-8e92-375315fbdae4 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df7a3089-02a7-4afb-b2c2-da31ccc79e1c tempest-VolumesGetTestJSON-1288781047 tempest-VolumesGetTestJSON-1288781047-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4" status: 404 len: 109 microversion: 2.1 time: 0.036307 May 23 18:09:56.535909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 164/318] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:09:56 2022] GET /compute/v2.1/os-volumes/2fdd9132-5b6d-455c-8e92-375315fbdae4 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:09:57.208864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:57.209564 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:57.216136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:57.216667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:57.217681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:57.218275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:57.364341 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:57.372501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-55227c24-4139-4725-b51e-915f8ac361b1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.167474 May 23 18:09:57.373171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 155/319] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:57 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:58.393024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:58.393024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:58.397700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:58.398147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:58.398945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:58.399438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:58.548135 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:58.556068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7f33aec3-2b2d-4656-9da3-6f735707d6b0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.170723 May 23 18:09:58.557225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 165/320] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:58 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:09:59.573517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:09:59.574124 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:09:59.580950 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:59.581401 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:59.582162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:09:59.582598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:09:59.714315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:09:59.722544 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-02a7e027-1124-4a1c-ab6c-4379bc8d7ef5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.152833 May 23 18:09:59.723156 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 156/321] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:09:59 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:00.739599 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:00.740197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:00.746282 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:00.746747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:00.747499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:00.747924 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:00.881762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:00.890419 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d61d94bd-41bf-454c-aaf4-525064d8cce9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1523 microversion: 2.1 time: 0.154498 May 23 18:10:00.891097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 166/322] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:00 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:01.908282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:01.908917 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:01.915516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:01.915960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:01.916712 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:01.917165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:02.046664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:02.054256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-985c6dfb-6edc-456e-af3f-f2f869eeb571 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1503 microversion: 2.1 time: 0.150727 May 23 18:10:02.054905 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 157/323] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:01 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:02.070899 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:02.071500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:02.077668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:02.078106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:02.078927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:02.079386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:02.082061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=86 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:02.223406 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:02.231103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-71cd9eef-10f2-42e5-b2c8-9b5a06eb2009 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1517 microversion: 2.1 time: 0.163947 May 23 18:10:02.231663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 167/324] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:02 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:03.680050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:03.681194 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:03.690370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:03.691032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:03.691814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:03.692454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:03.716099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lazy-loading 'flavor' on Instance uuid fb843a05-dbd1-4fbf-94a9-1dff354593f0 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:10:03.837198 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-735fc9f6-4cda-4598-82a7-ae23036ac5b4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0/action" status: 200 len: 32 microversion: 2.1 time: 0.160902 May 23 18:10:03.838444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 158/325] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:10:03 2022] POST /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:10:03.848619 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:03.849346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:03.856453 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:03.857503 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:03.858626 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:03.859109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:04.064645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:04.078935 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-34444520-cf4d-4868-aa92-c0360c9a7511 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.234862 May 23 18:10:04.090131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 168/326] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:03 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:05.099166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:05.099904 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:05.108494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:05.109497 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:05.109893 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:05.110360 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:05.325336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:05.338635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-94c5f48e-dcd2-4b13-abea-32be8745813c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.246308 May 23 18:10:05.339355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 159/327] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:05 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:06.359990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:06.360831 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:06.367011 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=30 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:06.369449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:06.370098 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:06.371062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:06.371639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:06.519157 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:06.526896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dfac6612-5e81-437a-8534-8308d61f3026 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.173706 May 23 18:10:06.527426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 169/328] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:06 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:07.545261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:07.546744 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:07.554270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:07.555071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:07.556094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:07.556840 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:07.781411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:07.789437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51ea1195-7418-4a30-a823-81fe2a634f49 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.248427 May 23 18:10:07.799355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 160/329] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:07 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:08.806827 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:08.807443 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:08.827931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:08.828393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:08.829176 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:08.829611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:09.134147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:09.147288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2261773b-0eb7-490a-b107-4f579b9b149e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.343550 May 23 18:10:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 170/330] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:08 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:10.100787 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2098299648", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "networks": [{"uuid": "1be86e9e-9354-4908-a261-72437ace367c"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:10.125965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=32 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:10.165220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:10.166194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:10.176479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:10.176941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:10.177738 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:10.180535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:10.186232 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] validate_networks() for [('1be86e9e-9354-4908-a261-72437ace367c', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:10:10.441923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:10.455787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2bf0daa2-c8a8-433c-936a-6ef6fb557d38 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.294302 May 23 18:10:10.456700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 171/331] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:10 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:11.179518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:10:11.182132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:10:11.182933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:10:11.183415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:10:11.183994 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:10:11.195143 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:11.195665 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:11.196535 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:11.197864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:11.220874 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Getting quotas for project eefd7a6998d24e0189ed1c54dc911737. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:11.225432 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Getting quotas for user 3bc1f574f2e84b47ad12c67641cc087c and project eefd7a6998d24e0189ed1c54dc911737. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:11.241282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:10:11.244259 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:10:11.302081 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ce3806e-ecd0-4af4-93e9-587b41663232 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207202 May 23 18:10:11.304066 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 161/332] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:10:11.314207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5d755a0-85f1-4ca9-a2ea-59b3407789df tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:11.314871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5d755a0-85f1-4ca9-a2ea-59b3407789df tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:11.392245 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e5d755a0-85f1-4ca9-a2ea-59b3407789df tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:11.399380 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5d755a0-85f1-4ca9-a2ea-59b3407789df tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1219 microversion: 2.1 time: 0.089633 May 23 18:10:11.399953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 172/333] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:11 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:11.473572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:11.474179 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:11.485198 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:11.485583 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:11.486361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:11.486826 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:11.768860 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:11.778407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-99be9044-104a-49dd-9db4-56885deeafd0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.308692 May 23 18:10:11.779545 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 162/334] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:11 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:12.421315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:12.423399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:12.431010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:12.431682 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:12.432643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:12.433232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:12.547329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:12.562454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-245d9408-c3d1-45d7-b4fc-63c32ca5cfc9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1271 microversion: 2.1 time: 0.147765 May 23 18:10:12.572947 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 173/335] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:12 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:12.797730 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:12.800070 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:12.824967 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:12.825741 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:12.826855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:12.827563 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:13.356504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:13.366513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3c594075-36e0-4469-b9d0-9a49494c21e3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.574279 May 23 18:10:13.371751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 163/336] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:12 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:13.590600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:13.592514 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:13.598898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:13.609617 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:13.610568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:13.611291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:13.730520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:13.739104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-69875b9a-4422-4adc-a137-01e40b990f63 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1277 microversion: 2.1 time: 0.153327 May 23 18:10:13.739674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 174/337] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:13 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:14.392645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:14.393833 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:14.412733 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:14.414944 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:14.416663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:14.419304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:14.757830 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:14.758523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:14.768929 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:14.769387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:14.770180 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:14.773469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:14.865947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:14.878035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-35cd0bb5-b330-4e65-bb8b-3d66c6d97650 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.491841 May 23 18:10:14.878616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 164/338] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:14 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:15.265761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:15.297431 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b3c01eb5-48e7-4c7c-b323-3571001eac27 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.544572 May 23 18:10:15.298557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 175/339] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:14 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:15.902049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:15.902671 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:15.911147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:15.911848 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:15.912792 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:15.913395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:16.315472 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:16.316086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:16.340557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:16.340745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:16.344507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:16.345014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:16.615537 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:16.631166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e35ad189-4877-4a05-b9ae-e9ee5d969606 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.738878 May 23 18:10:16.632004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 165/340] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:15 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:16.636688 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-963cbdf7-8dd2-45fb-9ca3-5005e56be457 req-3efe265a-fa0d-43c2-83e2-e4f7bd95e2bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f54f9aa-b925-4447-9087-41973631332d", "tag": "d8ae9041-7cdd-40d4-8352-23e8c761da28"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:16.657998 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-963cbdf7-8dd2-45fb-9ca3-5005e56be457 req-3efe265a-fa0d-43c2-83e2-e4f7bd95e2bb service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:16.658439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-963cbdf7-8dd2-45fb-9ca3-5005e56be457 req-3efe265a-fa0d-43c2-83e2-e4f7bd95e2bb service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:16.662727 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:16.686966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-963cbdf7-8dd2-45fb-9ca3-5005e56be457 req-3efe265a-fa0d-43c2-83e2-e4f7bd95e2bb service nova] Creating event network-changed:d8ae9041-7cdd-40d4-8352-23e8c761da28 for instance 8f54f9aa-b925-4447-9087-41973631332d on hv-cinder-75078 May 23 18:10:16.699411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-963cbdf7-8dd2-45fb-9ca3-5005e56be457 req-3efe265a-fa0d-43c2-83e2-e4f7bd95e2bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066129 May 23 18:10:16.707823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 166/341] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:10:17.053022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:17.068294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-44014df7-1a40-4d4e-85b8-958f3a50cd0a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.758055 May 23 18:10:17.076123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 176/342] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:16 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:17.650413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:17.652032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:17.677614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:17.678081 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:17.688888 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:17.690638 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:18.093478 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:18.094097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:18.105993 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:18.106439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:18.107527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:18.108207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:18.500805 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:18.547924 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d84de461-dfa9-4c30-82a5-87dde78459cd tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.459010 May 23 18:10:18.573407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 177/343] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:18 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:18.711305 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:18.723218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-046e7a66-9056-4da8-ae90-3120f1baf87b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 1.075963 May 23 18:10:18.724634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 167/344] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:17 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:19.588087 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:19.588878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:19.601594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:19.608075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:19.609911 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:19.619376 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:19.743534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:19.744348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:19.756044 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:19.759156 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:19.761162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:19.765032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:20.266425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:20.276239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-29b391c6-42c5-414f-b010-3c4c5db6bed6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.692061 May 23 18:10:20.277310 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 178/345] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:19 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:20.648775 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:20.667987 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b7439e3-d51c-4a18-8674-6328d80da22f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.927058 May 23 18:10:20.668901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 168/346] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:19 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:21.294168 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:21.295541 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:21.302765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:21.304167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:21.305261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:21.305950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:21.402379 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:21.688855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:21.690058 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:21.694233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:21.695931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:21.708200 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:21.708902 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:21.709883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:21.711672 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:21.792055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:21.805046 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc46b9b9-1d20-4685-8280-d7d88cb9e030 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.513920 May 23 18:10:21.818178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 179/347] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:21 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:22.110628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:22.132183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04411373-5639-473f-be85-fd17c165d906 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.443603 May 23 18:10:22.134435 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 169/348] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:21 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:22.823835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:22.824379 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:22.834516 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:22.835010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:22.835764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:22.836189 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:23.149790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:23.150901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:23.161023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:23.162967 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:23.166114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:23.167179 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:23.174455 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:23.184589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e25f4a94-8f78-45a1-b6b9-f17024ad7146 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.364471 May 23 18:10:23.186094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 180/349] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:22 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:23.803546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:23.813140 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6589cd40-358f-4633-95ae-65f0794b0b58 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.667278 May 23 18:10:23.823253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 170/350] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:23 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:24.063168 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2405377e-c2fa-4a74-a358-c6d767e266cb tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Action: 'create', calling method: .version_select at 0x7f8c1c2388b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1307402015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeV/Xpn3r3Sc9nuogVu5frtVcbvjYj1QfyJbppFj2pyo/GP1oY5vZDeASxMWnA2eu8R267NQCZJshaDwnFvSk5TXbtIeUw1eaCl000kHsDWOtmpvJeVo8cbcyavWmHiUg=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:24.099691 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-2405377e-c2fa-4a74-a358-c6d767e266cb tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:24.108794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-2405377e-c2fa-4a74-a358-c6d767e266cb tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for user 06b8d18d37e7467f84841ec6ac0080fb and project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:24.165005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2405377e-c2fa-4a74-a358-c6d767e266cb tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.413342 May 23 18:10:24.167276 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 181/351] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:10:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:10:24.205161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:24.206448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:24.223350 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:24.224025 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:24.224963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:24.225447 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:24.580585 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:24.603120 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-369a7ebb-24a1-4aeb-a7f8-195edc21e4b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.404451 May 23 18:10:24.603696 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 171/352] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:24 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:24.839109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:24.839731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:24.849702 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:24.851224 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:24.853585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:24.854034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:25.230520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:25.253473 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-135a46be-4114-41fc-a4dc-6d5dc5053514 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.418451 May 23 18:10:25.254398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 182/353] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:24 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:25.621522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:25.622968 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:25.634899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:25.635531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:25.637293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:25.640321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:26.030582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:26.039443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ec943040-4b5e-4690-be47-a3b4d66e2dd5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.422179 May 23 18:10:26.040027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 172/354] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:25 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:26.202604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-93053792-781d-4769-9094-12df29a520d4 req-8b692dc2-c35c-427f-a2a5-29d3430feb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f54f9aa-b925-4447-9087-41973631332d", "name": "network-vif-plugged", "status": "completed", "tag": "d8ae9041-7cdd-40d4-8352-23e8c761da28"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:26.216058 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-93053792-781d-4769-9094-12df29a520d4 req-8b692dc2-c35c-427f-a2a5-29d3430feb55 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:26.220064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-93053792-781d-4769-9094-12df29a520d4 req-8b692dc2-c35c-427f-a2a5-29d3430feb55 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:26.265057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-93053792-781d-4769-9094-12df29a520d4 req-8b692dc2-c35c-427f-a2a5-29d3430feb55 service nova] Creating event network-vif-plugged:d8ae9041-7cdd-40d4-8352-23e8c761da28 for instance 8f54f9aa-b925-4447-9087-41973631332d on hv-cinder-75078 May 23 18:10:26.276206 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:26.277268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:26.277961 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-93053792-781d-4769-9094-12df29a520d4 req-8b692dc2-c35c-427f-a2a5-29d3430feb55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078243 May 23 18:10:26.280767 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 183/355] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:10:26.312091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:26.313463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:26.314468 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:26.316085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:26.853218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:26.878028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8ae583ed-c5f1-40bc-b0b8-c2d5fc0654d5 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1503 microversion: 2.1 time: 0.598151 May 23 18:10:26.880189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 173/356] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:26 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1503 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:26.897935 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d592cc33-47f3-4740-a6f3-74cca704821a"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:26.900132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:26.919913 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:26.924132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:26.934195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:26.935430 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:27.042277 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] HTTP exception thrown: Cannot 'attach_volume' instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 while it is in vm_state rescued May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Request method failure captured: May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: POST /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0/os-volume_attachments HTTP/1.1 May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 74 May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii8127MkRXqbu9k9Nm02gGmw0dbE0r3UiP2ANN9q4-I1aSilsO_JAozGVgDSK_GRtdLX48pvQNSule4mkoeLNDfo3CowdogXzk6uDwy9pnvn6S_1Gz7-vtCHYsfELPbfQXjf7xtXXMjvgHMvcUQJVbxxdVUL7YIYcwbkXwZo2e8yNT2s May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:10:27.049933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: a57822c1558143d38ad17326a742c370 May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {"volumeAttachment": {"volumeId": "d592cc33-47f3-4740-a6f3-74cca704821a"}} May 23 18:10:27.053648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Cannot 'attach_volume' instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 while it is in vm_state rescued May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'server_id': 'fb843a05-dbd1-4fbf-94a9-1dff354593f0', 'body': {'volumeAttachment': {'volumeId': 'd592cc33-47f3-4740-a6f3-74cca704821a'}}} May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:10:27.054460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 while it is in vm_state rescued May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:10:27.055761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:10:27.058311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:10:27.058311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:10:27.058311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 while it is in vm_state rescued May 23 18:10:27.058311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:10:27.058311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Returning 409 to user: Cannot 'attach_volume' instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 while it is in vm_state rescued {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:10:27.067476 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:27.068233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:27.077496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8ea60476-0bc9-46d9-a292-520c101a3edb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.182216 May 23 18:10:27.084122 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 184/357] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:10:26 2022] POST /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0/os-volume_attachments => generated 152 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 18:10:27.089434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:27.096092 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:27.100425 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:27.100909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:27.108295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-633e734c-1dd6-4048-b89f-dc12e78fc3da tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:27.110657 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-633e734c-1dd6-4048-b89f-dc12e78fc3da tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:27.130543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-633e734c-1dd6-4048-b89f-dc12e78fc3da tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:27.131313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-633e734c-1dd6-4048-b89f-dc12e78fc3da tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:27.133041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-633e734c-1dd6-4048-b89f-dc12e78fc3da tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:27.134660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-633e734c-1dd6-4048-b89f-dc12e78fc3da tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:27.323969 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:27.346816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-633e734c-1dd6-4048-b89f-dc12e78fc3da tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0/action" status: 202 len: 0 microversion: 2.1 time: 0.259807 May 23 18:10:27.348514 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 185/358] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:10:27 2022] POST /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:10:27.385654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:27.386550 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:27.404559 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:27.406053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:27.407438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:27.409221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:27.589872 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:27.604313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b732f73b-75ae-4995-85e6-ddd071bdbd43 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.550864 May 23 18:10:27.605736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 174/359] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:27 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:27.866003 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:27.901731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e6107b52-7e8f-4ea4-9937-ef95e3904f7b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1511 microversion: 2.1 time: 0.527799 May 23 18:10:27.902796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 186/360] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:27 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:28.621974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:28.622767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:28.633607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:28.634257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:28.635289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:28.635871 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:28.921002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:28.921612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:28.928480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:28.929225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:28.930323 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:28.930898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:28.948688 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:28.957811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-24744523-ee97-476f-a21b-8c52cd1d32ae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1319 microversion: 2.1 time: 0.339695 May 23 18:10:28.958403 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 175/361] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:28 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:29.130729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:29.141263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83819e0b-1953-4db3-826a-410e887f5b7e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1511 microversion: 2.1 time: 0.224401 May 23 18:10:29.141780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 187/362] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:28 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:29.978889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:29.980451 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:30.002053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:30.006895 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:30.008178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:30.009068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:30.160040 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:30.160661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:30.173670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:30.174200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:30.176768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:30.177229 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:30.452051 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:30.461139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:30.462951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1cb45396-cba3-4afa-9224-422815555570 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1511 microversion: 2.1 time: 0.307594 May 23 18:10:30.463564 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 188/363] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:30 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:30.476710 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-59ffa0df-7a51-41a0-941c-3ed44c71ef20 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1507 microversion: 2.1 time: 0.505865 May 23 18:10:30.478005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 176/364] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:29 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:31.480301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:31.480897 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:31.499467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:31.499926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:31.500709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:31.508278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:31.869933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:31.885512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1beb4d6c-c0cf-4944-9863-f9782fb87ba7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1511 microversion: 2.1 time: 0.408122 May 23 18:10:31.897640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 189/365] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:31 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:32.905513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:32.906186 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:32.926668 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:32.927250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:32.927819 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:32.928587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:33.460548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:33.471414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-32ba4a4d-c7fe-4e1f-a33e-f529d0791a8c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1517 microversion: 2.1 time: 0.570363 May 23 18:10:33.479775 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 177/366] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:32 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1517 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:35.238768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5f1a6371-6968-4e1c-aa39-ab9ffcaaa76c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'create', calling method: .version_select at 0x7f8c1c1c6790>, body: {"keypair": {"name": "tempest-keypair-205514635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMpu4rPFGHKhlY0EV/5G95Z6gBwujoxoJJ56/xNQ0veJfg633gJVM4N7RexKHxktKTOim6FT3rEIa0BYbMKw6pb/gTVDpZpSIW96IXk0nI39D6uax/stkJq2axx/otxPw=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:35.247523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:35.258010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-5f1a6371-6968-4e1c-aa39-ab9ffcaaa76c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for project 74d48ee3a0df47dab968b0b92443648c. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:35.261979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-5f1a6371-6968-4e1c-aa39-ab9ffcaaa76c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for user a57822c1558143d38ad17326a742c370 and project 74d48ee3a0df47dab968b0b92443648c. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:35.301756 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5f1a6371-6968-4e1c-aa39-ab9ffcaaa76c tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067251 May 23 18:10:35.302350 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 190/367] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:10:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:10:37.036795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-115140016", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a57948d-e894-48fd-8fca-36b77c7b9fb4"}], "security_groups": [{"name": "tempest-securitygroup--1627806363"}], "key_name": "tempest-keypair-205514635", "user_data": "}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:43.155209 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=24 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:43.159647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1760629245", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:43.166375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:43.467454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=67 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:45.280835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:47.073681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:47.178591 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] validate_networks() for None {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:10:47.271119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] validate_networks() for [('7a57948d-e894-48fd-8fca-36b77c7b9fb4', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:10:47.626800 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:10:47.627472 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:10:47.628104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:10:47.628686 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:10:47.629258 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:10:47.642829 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:47.643577 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:47.644567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:47.645171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:47.666082 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Getting quotas for project bfcac6234abb473aba962b7dc9e4a3c3. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:47.671461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Getting quotas for user 2b641e57278c40faa5d20ea1ef7154bd and project bfcac6234abb473aba962b7dc9e4a3c3. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:47.685208 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:10:47.688411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:10:47.794341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-73af08ff-2a41-441d-ab11-1f15e9ee0f42 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.639060 May 23 18:10:47.802625 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 191/368] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 18:10:47.810598 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1677007660", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "networks": [{"uuid": "2c6e3be5-c742-460e-a98b-5e7f1f8e7c51"}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:47.938205 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] validate_networks() for [('2c6e3be5-c742-460e-a98b-5e7f1f8e7c51', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:10:48.075848 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:10:48.076613 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:10:48.077161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:10:48.077578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:10:48.077995 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:10:48.104635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:48.106319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:48.109917 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:48.115157 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:48.140893 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for project 74d48ee3a0df47dab968b0b92443648c. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:48.146548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Getting quotas for user a57822c1558143d38ad17326a742c370 and project 74d48ee3a0df47dab968b0b92443648c. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:48.171015 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:10:48.173953 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:10:48.251263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5e54763a-8cc6-40bd-9a23-74b86df21104 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 11.220159 May 23 18:10:48.252567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 178/369] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:10:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 11222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:10:48.258356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6f1ad526-af7b-4dc0-b8b0-e58118e7c696 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:48.259454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6f1ad526-af7b-4dc0-b8b0-e58118e7c696 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:48.332358 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6f1ad526-af7b-4dc0-b8b0-e58118e7c696 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:48.347016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6f1ad526-af7b-4dc0-b8b0-e58118e7c696 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1215 microversion: 2.1 time: 0.093110 May 23 18:10:48.347755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 179/370] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:48 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:48.371200 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-36bf7d24-ef04-44f3-8a26-01d00d4bf143 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:48.372288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-36bf7d24-ef04-44f3-8a26-01d00d4bf143 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:48.454824 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36bf7d24-ef04-44f3-8a26-01d00d4bf143 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:48.468394 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-36bf7d24-ef04-44f3-8a26-01d00d4bf143 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1244 microversion: 2.1 time: 0.107736 May 23 18:10:48.469764 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 180/371] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:48 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:48.538097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:10:48.538653 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:10:48.539140 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:10:48.539402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:10:48.539872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:10:48.552600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:48.553717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:48.555482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:48.556517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:48.582025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Getting quotas for project c743c4e622a84f7e9a2bf858b3a164fe. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:48.588867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Getting quotas for user 7ca87844c7ef4b2da0a12915aeff81a0 and project c743c4e622a84f7e9a2bf858b3a164fe. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:48.602225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:10:48.605035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:10:48.684311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-40cff0ae-bf83-44d4-8895-8c5665d33e9b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879954 May 23 18:10:48.685201 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 192/372] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:10:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:10:48.702488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e6ab0481-7a72-4212-82cb-46d56a891e85 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:48.703750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e6ab0481-7a72-4212-82cb-46d56a891e85 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:48.776579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e6ab0481-7a72-4212-82cb-46d56a891e85 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:48.787735 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e6ab0481-7a72-4212-82cb-46d56a891e85 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1214 microversion: 2.1 time: 0.094579 May 23 18:10:48.791038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 181/373] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:48 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:49.367088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dbfd2c91-b78e-4ecf-a060-08f26b608337 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:49.368085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dbfd2c91-b78e-4ecf-a060-08f26b608337 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:49.462723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dbfd2c91-b78e-4ecf-a060-08f26b608337 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:49.471833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dbfd2c91-b78e-4ecf-a060-08f26b608337 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1215 microversion: 2.1 time: 0.111336 May 23 18:10:49.473103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 193/374] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:49 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:49.487235 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ec97708-85ea-4f43-8a2d-7b55ac6de8df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:49.487927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ec97708-85ea-4f43-8a2d-7b55ac6de8df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:49.548340 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4ec97708-85ea-4f43-8a2d-7b55ac6de8df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:49.555056 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ec97708-85ea-4f43-8a2d-7b55ac6de8df tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1244 microversion: 2.1 time: 0.071275 May 23 18:10:49.556330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 182/375] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:49 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:49.810764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:49.811383 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:49.825545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:49.826454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:49.827714 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:49.828366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:49.910121 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:49.923942 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-657dd631-e759-4a72-897c-5bac89478ed7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1266 microversion: 2.1 time: 0.117890 May 23 18:10:49.924830 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 194/376] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:49 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:50.490075 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:50.491400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:50.498532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:50.499448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:50.500471 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:50.501127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:50.575747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:50.576746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:50.584015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:50.584520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:50.585363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:50.585806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:50.587053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:50.594855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f7bcad8b-6e2d-4e42-8b16-fad2ad4586fe tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1219 microversion: 2.1 time: 0.109751 May 23 18:10:50.604089 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 183/377] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:50 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:50.667715 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:50.679110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-11769668-3a48-4299-80df-b5b2306e2304 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1296 microversion: 2.1 time: 0.108003 May 23 18:10:50.690294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 195/378] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:50 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:50.943866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:50.944889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:50.954758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:50.968844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:50.970376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:50.972473 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:51.315968 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:51.323676 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df5abbcf-ba07-461f-99c3-673bdc975fc6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.383678 May 23 18:10:51.324286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 184/379] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:50 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:51.612028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:51.613431 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:51.633732 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:51.634554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:51.635599 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:51.636251 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:51.697429 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:51.698929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:51.715645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:51.716381 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:51.717380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:51.718028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:51.920553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:51.930224 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:51.932118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ba1f8805-0d91-475a-a327-110604bd9a74 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1275 microversion: 2.1 time: 0.324121 May 23 18:10:51.934090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 196/380] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:51 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:51.950133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8a424a38-2e76-4d16-9ace-2aaddc4d826b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1302 microversion: 2.1 time: 0.256470 May 23 18:10:51.960129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 185/381] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:51 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1302 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:52.343018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:52.344088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:52.358821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:52.360534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:52.361527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:52.363798 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:52.696966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:52.710864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce6ca9e2-13bf-4db1-8858-5ea86baa510b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.372988 May 23 18:10:52.712554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 197/382] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:52 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:52.950354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:52.951090 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:52.967911 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:52.968621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:52.974480 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:52.984391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:52.985098 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:52.986235 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:52.986661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:52.987116 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:52.991227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:52.992058 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:53.229135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:53.264165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c99cb454-b30b-4269-ad06-699d887927f6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1273 microversion: 2.1 time: 0.316361 May 23 18:10:53.265514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 186/383] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:52 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:53.349439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:53.360220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-471d9719-0b76-480e-9e93-2d0732bb89fe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.394306 May 23 18:10:53.367918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 198/384] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:52 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:53.584154 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-f08fec57-0b33-4be2-8fb1-49c104d1f90d req-e8d21d73-fea5-4287-8eb4-13a90d687872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69c757e-08bd-4a68-91ec-ce0fbad018ad", "tag": "ee02749d-1d0e-478e-ad90-83c15e48c971"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:53.586298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-9e836439-b09e-4f3a-94d3-0e15620c3a3b req-813c024e-8720-4742-9ede-049227736bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af994d05-2cb5-4804-ac2c-46d19e2d04b1", "tag": "3e5629ff-ce51-43da-9392-add0febcff5b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:53.601675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f08fec57-0b33-4be2-8fb1-49c104d1f90d req-e8d21d73-fea5-4287-8eb4-13a90d687872 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:53.602127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f08fec57-0b33-4be2-8fb1-49c104d1f90d req-e8d21d73-fea5-4287-8eb4-13a90d687872 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:53.611387 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-9e836439-b09e-4f3a-94d3-0e15620c3a3b req-813c024e-8720-4742-9ede-049227736bb6 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:53.612153 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-9e836439-b09e-4f3a-94d3-0e15620c3a3b req-813c024e-8720-4742-9ede-049227736bb6 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:53.635892 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-9e836439-b09e-4f3a-94d3-0e15620c3a3b req-813c024e-8720-4742-9ede-049227736bb6 service nova] Creating event network-changed:3e5629ff-ce51-43da-9392-add0febcff5b for instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 on hv-cinder-75078 May 23 18:10:53.637930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-f08fec57-0b33-4be2-8fb1-49c104d1f90d req-e8d21d73-fea5-4287-8eb4-13a90d687872 service nova] Creating event network-changed:ee02749d-1d0e-478e-ad90-83c15e48c971 for instance e69c757e-08bd-4a68-91ec-ce0fbad018ad on hv-cinder-75078 May 23 18:10:53.648270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-9e836439-b09e-4f3a-94d3-0e15620c3a3b req-813c024e-8720-4742-9ede-049227736bb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069387 May 23 18:10:53.649823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-f08fec57-0b33-4be2-8fb1-49c104d1f90d req-e8d21d73-fea5-4287-8eb4-13a90d687872 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072297 May 23 18:10:53.651876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 187/385] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:10:53.655702 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 199/386] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:10:53.728810 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:53.729769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:53.750087 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:53.750545 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:53.751362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:53.756056 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:54.088745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:54.098828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c0055301-155a-40d7-abcd-e649689b3186 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.373451 May 23 18:10:54.102995 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 188/387] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:53 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:54.283253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:54.283879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:54.293739 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:54.294191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:54.295121 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:54.295562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:54.375159 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:54.387773 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:54.409637 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:54.410101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:54.410914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:54.411362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:54.633211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:54.648154 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1e88db12-7f96-450c-8d5e-ee37416edfcc tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.369377 May 23 18:10:54.648759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 200/388] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:54 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:54.825940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:54.833721 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8bea080e-40a6-4279-8b11-442af9c68e12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.462845 May 23 18:10:54.843431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 189/389] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:54 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:55.118662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:55.122053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:55.128932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.135029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.137839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.138365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.245178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eb96c9f7-fabb-4f7c-a214-41b865c9a760 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Action: 'create', calling method: .version_select at 0x7f8c1c1e03a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1464658032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOnY/N5AQ5h9enIl1y83qcCoK6Lem7rXYqEwwuWWcAqFDaeLDhdjacSOyRNgErpxEqjlTGKLg2RL/ljBDWUItf0McUi+aUeOZKDbtpG9uqxYEveZyffHVm9+Vtel0N6IA=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:55.272798 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-eb96c9f7-fabb-4f7c-a214-41b865c9a760 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Getting quotas for project f7e38224b6a74df8b5e931ccda46d3fd. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:55.278340 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-eb96c9f7-fabb-4f7c-a214-41b865c9a760 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Getting quotas for user b04754683c9d4f9492f474fa30bea1c2 and project f7e38224b6a74df8b5e931ccda46d3fd. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:55.316715 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eb96c9f7-fabb-4f7c-a214-41b865c9a760 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.074725 May 23 18:10:55.322995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:55.327028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 190/390] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:10:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:10:55.332902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87ee3350-02d8-49aa-a653-23601257a6bf tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.220047 May 23 18:10:55.333470 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 201/391] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:55 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:55.375274 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-698493300", "imageRef": "a7b7fb07-b5be-4dee-aa61-d64fc576727e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1464658032", "networks": [{"uuid": "c7cfcf58-7438-49ee-9044-fd6309c8134a"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:55.428983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] validate_networks() for [('c7cfcf58-7438-49ee-9044-fd6309c8134a', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:10:55.664335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:55.664952 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:55.671668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.672118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.672881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.673315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.799571 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:10:55.800120 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:10:55.800665 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:10:55.801070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:55.801192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:10:55.801659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:10:55.808493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-70490362-95f3-4582-a880-37f076a1d68b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.147959 May 23 18:10:55.810270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 202/392] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:55 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:55.810616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.811189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.812203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.812707 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.815103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-1e0b25ae-466a-49df-b902-71961547a591 req-1056c04a-b7d0-46a5-83ab-b119dfa13271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161f981-61b7-4f97-b35e-9be65f749c3f", "tag": "a201ef56-1bfa-4d49-9aa4-dbef0f844919"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:10:55.823004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-1e0b25ae-466a-49df-b902-71961547a591 req-1056c04a-b7d0-46a5-83ab-b119dfa13271 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.823435 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-1e0b25ae-466a-49df-b902-71961547a591 req-1056c04a-b7d0-46a5-83ab-b119dfa13271 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.830268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Getting quotas for project f7e38224b6a74df8b5e931ccda46d3fd. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:10:55.834315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-1e0b25ae-466a-49df-b902-71961547a591 req-1056c04a-b7d0-46a5-83ab-b119dfa13271 service nova] Creating event network-changed:a201ef56-1bfa-4d49-9aa4-dbef0f844919 for instance 5161f981-61b7-4f97-b35e-9be65f749c3f on hv-cinder-75078 May 23 18:10:55.834460 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Getting quotas for user b04754683c9d4f9492f474fa30bea1c2 and project f7e38224b6a74df8b5e931ccda46d3fd. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:10:55.839159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-1e0b25ae-466a-49df-b902-71961547a591 req-1056c04a-b7d0-46a5-83ab-b119dfa13271 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027544 May 23 18:10:55.840306 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 203/393] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:10:55.847959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:10:55.850137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b7fb07-b5be-4dee-aa61-d64fc576727e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:10:55.850680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:55.851396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:55.858196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.858583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.859360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:55.859797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:55.895231 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-657b7c3c-b857-4c0d-945b-dff574afdc6c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524628 May 23 18:10:55.896074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 191/394] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:10:55.906265 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-72ad2a34-7a55-45e2-ba7d-dde6677a4655 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:55.906931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-72ad2a34-7a55-45e2-ba7d-dde6677a4655 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:55.962591 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-72ad2a34-7a55-45e2-ba7d-dde6677a4655 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:55.970525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-72ad2a34-7a55-45e2-ba7d-dde6677a4655 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1258 microversion: 2.1 time: 0.068619 May 23 18:10:55.971444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 192/395] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:55 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:56.011136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:56.019315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ae38ff18-bcd7-426f-89ea-3d3b794fd0e1 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.172552 May 23 18:10:56.020238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 204/396] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:55 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:56.349962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:56.350575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:56.357779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:56.358228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:56.359080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:56.359461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:56.504788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:56.513903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-baeb2be2-6e34-41ba-8919-f2a846876afe tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.166474 May 23 18:10:56.513903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 193/397] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:56 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:56.825313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:56.825940 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:56.832160 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:56.832601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:56.833352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:56.833782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:56.957816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:56.965777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6ac7fc24-beaa-49ed-ac58-29d10d355857 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.144464 May 23 18:10:56.966326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 205/398] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:56 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:56.987342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:56.987982 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:56.994030 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:56.994482 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:56.995268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:56.995726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:57.036213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:57.036816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:57.043326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:57.043773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:57.044532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:57.044960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:57.057041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:57.065263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8cf585b6-1736-4785-b5e9-ec2c560cf148 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1262 microversion: 2.1 time: 0.081740 May 23 18:10:57.066041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 194/399] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:56 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:57.175871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:57.183312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83c43fc5-2676-4731-8acd-6eeb70f06854 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.150889 May 23 18:10:57.184037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 206/400] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:57 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:10:57.532853 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:57.533457 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:57.540104 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:57.540583 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:57.541365 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:57.541803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:57.669289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:57.676706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0583be93-5a46-4000-9a7b-8ef9698a5d4a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.147675 May 23 18:10:57.677287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 195/401] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:57 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:57.982486 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:57.983110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:57.989139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:57.989575 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:57.990319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:57.990761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:58.081222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:58.081956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:58.088079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:58.088528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:58.089320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:58.090043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:58.116500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:58.125977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-637c4cd6-8375-48d5-93c5-a1f0d22bcfb4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.147378 May 23 18:10:58.126535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 207/402] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:57 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:58.154365 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:58.161659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4bcd4018-c3ea-4212-b811-4447f705716b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1262 microversion: 2.1 time: 0.084301 May 23 18:10:58.162214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 196/403] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:58 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:58.200538 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:58.201149 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:58.207153 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:58.207600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:58.208364 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:58.208793 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:58.335825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:58.343374 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6d79e499-01ce-4dd8-ab3f-a7c9715cb228 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.147293 May 23 18:10:58.343931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 208/404] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:58 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:58.693282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:58.693930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:58.700785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:58.701234 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:58.701999 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:58.702468 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:58.829992 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:58.837360 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-73aada29-1592-4948-bbdf-de255a04f48c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.147905 May 23 18:10:58.837916 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 197/405] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:58 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:59.143394 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:59.143986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:59.145937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:59.151751 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.152849 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.153750 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.154186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.178684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:59.179316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:59.185284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.185739 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.186501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.186972 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.248988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:59.257557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-38b397a0-e6d4-4766-b412-ac8647f6fe54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1262 microversion: 2.1 time: 0.082654 May 23 18:10:59.264248 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 198/406] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:59 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:59.294252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:59.301593 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8e3dce62-17d1-45bf-95e6-5a7f0f885752 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.162133 May 23 18:10:59.302152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 209/407] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:59 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:59.360489 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:59.361106 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:59.367134 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.367586 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.368350 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.368791 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.496531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:10:59.503961 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a54c5b21-0590-4c3d-817b-386451c7f567 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.147412 May 23 18:10:59.504528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 199/408] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:59 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:10:59.854722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:10:59.855348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:10:59.857253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=14 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:59.863179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.863624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.864376 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:10:59.864807 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:10:59.992710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:00.000586 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9527dadb-fe7e-47b4-ae60-9d91f55d9303 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.149788 May 23 18:11:00.001175 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 210/409] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:10:59 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:00.276021 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:00.276631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:00.289752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:00.290218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:00.292072 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:00.292072 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:00.321064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:00.322344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:00.330738 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:00.331667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:00.332624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:00.333226 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:00.338312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:00.366690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:00.377397 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b930cd6-3ed7-44ea-9a3b-b4e286f28ba2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1254 microversion: 2.1 time: 0.105131 May 23 18:11:00.378286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 200/410] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:00 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1254 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:00.520241 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:00.520859 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:00.527189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:00.527971 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:00.528770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:00.529204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:00.669450 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:00.677207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-47f4cfc1-e5ea-4f86-8bf3-2871f178962a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.160839 May 23 18:11:00.678079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 201/411] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:00 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:00.688762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:00.696123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-33e2375d-c399-4883-8c14-c8f85693b480 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.380983 May 23 18:11:00.696650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 211/412] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:00 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:01.017082 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:01.017630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:01.020652 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:01.024574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.025019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.025769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.026199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.046342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:01.165805 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:01.173895 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d40e7fb7-1888-454a-a97a-802f919d88f1 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.160735 May 23 18:11:01.174450 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 202/413] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:01 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:01.395636 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:01.396250 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:01.403724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.404201 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.404990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.405421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.465260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:01.472754 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-08916ce5-6662-4501-a8fa-84a6f6633cc4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1310 microversion: 2.1 time: 0.080938 May 23 18:11:01.473305 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 212/414] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:01 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:01.694278 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:01.694962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:01.702673 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.703157 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.703933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.704344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.713034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:01.713781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:01.720490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.720643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.721476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:01.722029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:01.845849 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:01.854556 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7294d80c-2ce0-48a2-8857-8b43fb95417d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.163949 May 23 18:11:01.864553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 203/415] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:01 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:01.867797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:01.876337 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f3ab5811-4dde-4f82-bdd1-f8eba0f79a00 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.167085 May 23 18:11:01.877334 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 213/416] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:01 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:02.190749 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:02.191284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:02.197271 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.197718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:02.198462 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.199080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:02.328734 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:02.336091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2987a658-2051-4065-8969-81127a682a76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.149302 May 23 18:11:02.336702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 204/417] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:02 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:02.489408 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:02.490008 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:02.496188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.496664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:02.497410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.497831 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:02.562015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:02.569267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eed2b840-1408-4f4d-aa19-14915afdcb55 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1310 microversion: 2.1 time: 0.083623 May 23 18:11:02.569825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 214/418] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:02 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:02.871584 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:02.872230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:02.878656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.879296 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:02.880207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.880923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:02.893520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:02.894158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:02.910475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.910950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:02.911904 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:02.912342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:03.029275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:03.037024 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-45db5dab-e37d-4c08-bba6-bd2478735829 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.169324 May 23 18:11:03.037643 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 205/419] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:02 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:03.041994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:03.052779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-994a0a4c-18ca-4722-b497-f3a9951bdebd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.163302 May 23 18:11:03.053346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 215/420] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:02 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:03.353540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:03.354068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:03.360378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:03.361162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:03.362550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:03.363102 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:03.501609 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:03.509168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7f136d3c-9c0b-46eb-9f36-921fc4b6befa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.159615 May 23 18:11:03.509928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 206/421] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:03 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:03.586297 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:03.587019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:03.593438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:03.593916 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:03.594796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:03.595235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:03.656910 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:03.664438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-24bdf901-807c-44de-ac29-d634a8aa8ebc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1310 microversion: 2.1 time: 0.082030 May 23 18:11:03.665074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 216/422] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:03 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:04.054605 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:04.055292 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:04.062542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.063015 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.063769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.064201 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.070846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:04.071452 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:04.077419 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.077868 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.078627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.079083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.195451 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:04.203393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-513e71b2-2bbb-4aa1-8493-bed23ef98a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.152963 May 23 18:11:04.203966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 207/423] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:04 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:04.212856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:04.221042 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3ed21826-019e-42b8-b54c-f4b86d74ce3b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.154069 May 23 18:11:04.221585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 217/424] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:04 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:04.527828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:04.528453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:04.534518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.535080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.535972 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.536408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.683741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:04.684362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:04.686043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:04.691313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.691777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.692534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.692972 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.697280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c15fb324-a03d-49b0-8043-4e1df127df7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.173861 May 23 18:11:04.697963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 208/425] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:04 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:04.708878 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-1b923fa7-1c5a-4f57-b3d9-c0e3848ca869 req-fb1730c6-6d2e-482d-a13a-57c0cd3e8f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69c757e-08bd-4a68-91ec-ce0fbad018ad", "name": "network-vif-plugged", "status": "completed", "tag": "ee02749d-1d0e-478e-ad90-83c15e48c971"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:04.721121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1b923fa7-1c5a-4f57-b3d9-c0e3848ca869 req-fb1730c6-6d2e-482d-a13a-57c0cd3e8f42 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:04.721564 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1b923fa7-1c5a-4f57-b3d9-c0e3848ca869 req-fb1730c6-6d2e-482d-a13a-57c0cd3e8f42 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:04.734223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-1b923fa7-1c5a-4f57-b3d9-c0e3848ca869 req-fb1730c6-6d2e-482d-a13a-57c0cd3e8f42 service nova] Creating event network-vif-plugged:ee02749d-1d0e-478e-ad90-83c15e48c971 for instance e69c757e-08bd-4a68-91ec-ce0fbad018ad on hv-cinder-75078 May 23 18:11:04.741026 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-1b923fa7-1c5a-4f57-b3d9-c0e3848ca869 req-fb1730c6-6d2e-482d-a13a-57c0cd3e8f42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034635 May 23 18:11:04.741026 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 209/426] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:04.763068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:04.771203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5aef4a73-79bf-49b5-9510-66501a8ef55c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1310 microversion: 2.1 time: 0.093064 May 23 18:11:04.772183 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 218/427] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:04 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:05.222239 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:05.222958 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:05.229027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.229470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.231109 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.231547 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.237266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:05.237873 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:05.243940 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.244385 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.245143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.246170 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.367223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:05.375204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4a3a6e38-a86e-4ee5-86b2-81e8cb993183 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.157684 May 23 18:11:05.375705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 210/428] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:05 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:05.379640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:05.388103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3d49e10b-d0a2-467d-9a06-6b807db5b599 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.154615 May 23 18:11:05.388653 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 219/429] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:05 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:05.714907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:05.715519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:05.722779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.723225 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.724008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.724492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.787984 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:05.788582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:05.795823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.796258 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.797006 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:05.797434 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:05.820637 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:05.861373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:05.863400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:05.868887 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-74083cde-3dca-40ee-950c-c10f890ad99e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.158180 May 23 18:11:05.869456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 211/430] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:05 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:05.871710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0c893628-3419-41f6-85ab-ba49dd4937d3 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1310 microversion: 2.1 time: 0.087526 May 23 18:11:05.872511 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 220/431] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:05 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:06.394382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:06.395131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:06.397408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=26 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:06.405633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:06.406327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:06.410176 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:06.410661 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:06.411494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:06.411931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:06.423680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:06.424846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:06.425794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:06.426381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:06.671221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:06.684954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7b0d0b2-4ca9-47b7-9ab1-50f0029e1c90 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.283747 May 23 18:11:06.685761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 221/432] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:06 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:06.763710 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:06.782726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a097b414-0ecf-4717-b6ac-910787a8cc6e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.383657 May 23 18:11:06.782726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 212/433] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:06 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:06.876680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1799984475", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1307402015", "security_groups": [{"name": "tempest-secgroup-smoke-1146479828"}], "block_device_mapping_v2": [{"uuid": "d26846b2-d89c-4524-b55b-d9701aa2ca28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1d3a1f7-b777-4042-a243-d14c937aea70"}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:06.887530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:06.888258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:06.894256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:06.894827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:06.895924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:06.896439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.126668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] validate_networks() for [('a1d3a1f7-b777-4042-a243-d14c937aea70', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:11:07.215974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:07.226163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-baf36db8-ae9d-4271-9fa2-1a654b36155f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.342303 May 23 18:11:07.229482 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 213/434] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:06 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:07.234719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:07.235686 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:07.249618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.250345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.251352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.251939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.328687 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:07.342604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c8820b58-afe6-42f9-bb39-ffa375de757f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1316 microversion: 2.1 time: 0.111135 May 23 18:11:07.344146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 214/435] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:07 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:07.702228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:07.702966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:07.709518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.709976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.710770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.711242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.810280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:11:07.810728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:11:07.811204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:11:07.811610 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:11:07.812023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:11:07.821073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.821520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.822525 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.823039 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.842635 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:11:07.845283 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:07.849002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for user 06b8d18d37e7467f84841ec6ac0080fb and project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:11:07.860821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:07.868840 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae4a6852-82c0-43da-9f14-8b7c6a1c4ff8 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.171191 May 23 18:11:07.869414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 215/436] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:07 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:07.877287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:07.878067 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:07.887251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.887251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.888005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:07.888737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:07.944327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:11:07.946414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d26846b2-d89c-4524-b55b-d9701aa2ca28',volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:11:08.108798 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:08.119603 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-14632430-e02a-4429-96ab-f5ba05824b69 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.248928 May 23 18:11:08.122005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 216/437] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:07 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:08.128137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1322fb65-0da4-405d-9c2f-3e8ec8856f7c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1fbcc35-bfb8-454d-8c78-26b2bca3b58a", "device": "/dev/sdb"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:08.135989 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1322fb65-0da4-405d-9c2f-3e8ec8856f7c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:08.150017 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1322fb65-0da4-405d-9c2f-3e8ec8856f7c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.150766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1322fb65-0da4-405d-9c2f-3e8ec8856f7c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.152050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1322fb65-0da4-405d-9c2f-3e8ec8856f7c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.153264 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1322fb65-0da4-405d-9c2f-3e8ec8856f7c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.206915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8e2f0b02-6fde-461c-9721-552481250c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.332592 May 23 18:11:08.211357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 222/438] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:11:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:11:08.221196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-640b9244-6ba8-4545-9fc9-ebfad0c285d5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:08.221776 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-640b9244-6ba8-4545-9fc9-ebfad0c285d5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:08.286530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-640b9244-6ba8-4545-9fc9-ebfad0c285d5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:08.295806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-640b9244-6ba8-4545-9fc9-ebfad0c285d5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1095 microversion: 2.1 time: 0.079412 May 23 18:11:08.296912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 223/439] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:08 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:08.303053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:08.303937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:08.329658 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.331337 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.333175 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.333832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.533398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:08.540814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5783dfc-6d7a-402b-934f-a86008d5e5b6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.242403 May 23 18:11:08.541568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 224/440] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:08 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:08.546875 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:08.547642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:08.553631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.554057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.554842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.555269 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.772928 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:08.784540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-27eb4187-9543-43a9-954d-a83a7835d0e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.241715 May 23 18:11:08.785427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 225/441] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:08 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:08.878496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-9de036ee-890f-4b89-9e47-078e9fe260fa req-d5c162de-bd17-405a-b085-795fb07800d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af994d05-2cb5-4804-ac2c-46d19e2d04b1", "name": "network-vif-plugged", "status": "completed", "tag": "3e5629ff-ce51-43da-9392-add0febcff5b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:08.888969 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9de036ee-890f-4b89-9e47-078e9fe260fa req-d5c162de-bd17-405a-b085-795fb07800d2 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.889490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9de036ee-890f-4b89-9e47-078e9fe260fa req-d5c162de-bd17-405a-b085-795fb07800d2 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.902119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-9de036ee-890f-4b89-9e47-078e9fe260fa req-d5c162de-bd17-405a-b085-795fb07800d2 service nova] Creating event network-vif-plugged:3e5629ff-ce51-43da-9392-add0febcff5b for instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 on hv-cinder-75078 May 23 18:11:08.907480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-9de036ee-890f-4b89-9e47-078e9fe260fa req-d5c162de-bd17-405a-b085-795fb07800d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 May 23 18:11:08.908270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 226/442] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:11:08.913781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:08.914643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:08.922350 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.923411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:08.924493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:08.925102 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.088571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:09.097912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4119eead-baf2-4007-b9da-fa5aa19cd805 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.188634 May 23 18:11:09.098765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 227/443] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:08 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:09.138139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:09.138787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:09.144918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.145360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.146199 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.146624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.284781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:09.292545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-190ba521-4fe5-4dd6-ae05-a21961b8fd14 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.158545 May 23 18:11:09.293068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 228/444] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:09 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:09.313814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:09.314441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:09.320304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.320760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.321546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.321985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.387371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:09.394720 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fb97c50a-8096-4834-b8b3-510e0bd5dafc tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.084508 May 23 18:11:09.395283 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 229/445] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:09 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:09.559449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:09.559987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:09.566257 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.566770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.567553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.567983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.572346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:09.717474 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:09.725078 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0dfd51e0-0a0a-4865-bbe9-7a38bb8c478f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.169714 May 23 18:11:09.735945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 230/446] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:09 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:09.803101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:09.803713 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:09.810839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.811235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.812044 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:09.812482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:09.954844 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:09.962399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-39726105-3f6d-47d6-ad46-277639967efb tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.163166 May 23 18:11:09.968176 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 231/447] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:09 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:10.116018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:10.116841 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:10.123064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.123520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.124293 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.124733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.265517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:10.273676 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-accdf4a8-931e-4b67-9f39-2f4d06f6181c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.161586 May 23 18:11:10.274588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 232/448] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:10 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:10.309505 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:10.310117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:10.316604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.317060 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.317828 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.318260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.460527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:10.469134 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c4297d44-51ac-4915-90d2-0713b61645f0 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.163761 May 23 18:11:10.469698 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 233/449] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:10 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:10.474028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:10.474618 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:10.480612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.481049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.481791 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.482214 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.548263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:10.555743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bda33cf6-ecd8-43ec-bb60-b1db9d42bd90 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.085057 May 23 18:11:10.556537 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 234/450] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:10 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:10.743143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:10.743759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:10.751024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.751476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.752293 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.752690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.894797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:10.902180 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-289eaa9b-15d6-4377-a783-a549df3a22a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.162868 May 23 18:11:10.902743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 235/451] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:10 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:10.980564 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:10.981090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:10.987151 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.987630 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:10.988388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:10.988821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.123002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:11.131695 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b041a22a-bead-4ce4-afe1-f0f84c7278d4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.155429 May 23 18:11:11.132449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 236/452] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:10 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:11.293192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:11.293773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:11.300487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.300934 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.301702 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.302135 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.443786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:11.451729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a582779b-8c57-44c6-b2a7-c9b1881e4614 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.163902 May 23 18:11:11.452290 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 237/453] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:11 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:11.485626 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:11.486238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:11.492825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.493324 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.494107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.494547 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.629299 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:11.638019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-836fc73e-9a04-4912-a424-5c0dc8c38200 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.156200 May 23 18:11:11.638791 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 238/454] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:11 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:11.643140 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:11.643759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:11.653641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.654235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.655057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.655491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.719225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:11.727371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2675ec2f-7ee7-46ef-8a21-fad581420555 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.087673 May 23 18:11:11.737832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 239/455] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:11 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:11.919697 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:11.920497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:11.926767 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.927348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:11.928220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:11.928772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.085682 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:12.093844 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-19de17b3-228c-4bce-911d-fa06b453c709 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.178948 May 23 18:11:12.094423 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 240/456] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:11 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:12.148459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:12.149124 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:12.155789 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.156236 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.156988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.157421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.296116 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:12.304278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e0ba33b9-0ae8-4f3c-a9ad-67c58df36062 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.159674 May 23 18:11:12.304843 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 241/457] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:12 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:12.469639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:12.470218 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:12.476205 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.476648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.477394 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.477825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.618654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:12.626080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-738a3f83-227f-4bdf-8638-97eea9f42141 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.160474 May 23 18:11:12.626632 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 242/458] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:12 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:12.654997 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:12.655652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:12.661465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.661908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.662659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.663115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.802795 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:12.810240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-649c2057-514b-4647-bd52-f21a1ff488e6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.159469 May 23 18:11:12.810812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 243/459] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:12 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:12.815136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:12.815730 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:12.821262 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.821704 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.822480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:12.822943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:12.893871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:12.901362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6cfdcf82-bb0b-4c18-8bc4-9956e7e9389a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.089555 May 23 18:11:12.902276 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 244/460] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:12 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:13.111789 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:13.112393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:13.118992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.119435 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.121239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.121759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.258245 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:13.266263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b3d14f89-8b11-4e07-adbe-4a1a72809994 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.159051 May 23 18:11:13.268712 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 245/461] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:13 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:13.321188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:13.321845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:13.327936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.328382 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.329136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.329571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.465631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:13.469596 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:13.475017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-00fbbb76-15a5-4760-9c9e-5003f83ade6b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.157539 May 23 18:11:13.480333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 246/462] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:13 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:13.643244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:13.644330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:13.651668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.652266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.653437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.653918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.788496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:13.795980 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4aee043c-d37a-4885-ab38-14b2ae079fe3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.157207 May 23 18:11:13.796536 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 247/463] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:13 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:13.827500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:13.828112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:13.834378 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.834857 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.835627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.836063 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.965251 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:13.973410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f912eb95-cf47-4325-a453-e3f5c66d5ab9 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.150324 May 23 18:11:13.974408 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 248/464] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:13 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:13.980848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:13.981578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:13.988117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.988489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:13.989245 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:13.989671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:14.055919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:14.066115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a9dec189-60e9-4049-bda5-6cca9d7a7fb8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.090428 May 23 18:11:14.066689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 249/465] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:13 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:14.283056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:14.283693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:14.289534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:14.289968 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:14.290730 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:14.291159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:14.432617 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:14.438322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-42f71738-8448-4050-a57e-062cc104152c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.159130 May 23 18:11:14.438999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 250/466] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:14 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:14.491826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:14.492430 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:14.498734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:14.499220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:14.500009 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:14.500496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:14.632161 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:14.639578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-25dd2f42-f8ec-44ae-bf49-5c66a8bfabb0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.151469 May 23 18:11:14.640141 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 251/467] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:14 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:14.812164 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:14.812797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:14.819093 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:14.819545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:14.820329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:14.820770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:14.959022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:14.967470 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eed243b5-578d-4490-ae8e-f6d65092bd40 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.159242 May 23 18:11:14.968221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 252/468] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:14 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:14.991265 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:14.992181 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:15.001452 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.002156 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.002959 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.003440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.148543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:15.156846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c6c69e67-6d6a-405a-b8f6-010208fc5e25 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.170098 May 23 18:11:15.162859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 253/469] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:14 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:15.169364 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:15.177024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:15.183566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.184593 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.185456 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.185889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.245975 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:15.259462 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9455dcf9-8bf0-4b65-bf81-10c53ca865c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.100555 May 23 18:11:15.261450 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 254/470] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:15 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:15.455259 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:15.455968 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:15.461860 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.462311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.463103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.463537 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.599534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:15.608445 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0d89e988-32a2-4665-8c9c-da04fb7c8a93 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.156273 May 23 18:11:15.608984 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 255/471] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:15 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:15.657815 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:15.658432 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:15.665402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.665772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.666540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.666995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.805078 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:15.813479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0aefb35a-f137-4d8a-bc1d-d0d9e080a15e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.160512 May 23 18:11:15.814242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 256/472] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:15 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:15.985186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:15.985718 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:15.991806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.992258 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:15.993012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:15.993443 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.129604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:16.137970 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-909f5418-6c53-4dfa-b040-20d200b8e84f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.157215 May 23 18:11:16.139508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 257/473] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:15 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:16.180155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:16.180751 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:16.187658 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.188101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.188896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.189283 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.335956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:16.345331 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8943904e-2285-4ca0-ab22-cc3d9c8e9b73 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.168766 May 23 18:11:16.347110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 258/474] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:16 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:16.359655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:16.360841 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:16.367641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.368187 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.369017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.369513 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.436983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:16.445311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-84b12490-6a18-47bb-aac5-cc4478499851 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.096893 May 23 18:11:16.445885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 259/475] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:16 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:16.625618 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:16.626287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:16.632657 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.633160 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.633918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.634345 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.793829 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:16.801396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e0effc34-c6d4-4aae-b57c-4b09514a49bc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.180284 May 23 18:11:16.801954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 260/476] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:16 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:16.832046 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:16.832940 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:16.839857 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.840528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.841238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:16.841624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:16.974750 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:16.983090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0b723d48-2bf2-427c-80be-4209b03b9f54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.155138 May 23 18:11:16.983649 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 261/477] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:16 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:17.156132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:17.157634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:17.164458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.165263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.166266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.167248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.317646 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:17.325785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-33376608-bcdd-40df-8bab-5ac43ab87fb1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.173599 May 23 18:11:17.337194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 262/478] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:17 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:17.362921 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:17.363529 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:17.369667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.370117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.370911 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.371398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.389430 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:17.509549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:17.517953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7967cd5d-f3ce-46fc-8f18-6dbb1b435378 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.158889 May 23 18:11:17.527016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 263/479] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:17 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:17.527016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:17.527016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:17.530965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.531413 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.532183 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.532666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.595791 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:17.603509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3155b81c-cc40-4bac-bc3c-7acf276124a3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.083396 May 23 18:11:17.604072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 264/480] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:17 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:17.821204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:17.821870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:17.829373 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.829818 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.830583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:17.831043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:17.834979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:17.971540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:17.978861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-06b03b7d-813a-42f5-b51c-8dbf7d35669f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.162529 May 23 18:11:17.979427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 265/481] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:17 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:18.000509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:18.001118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:18.007549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.008001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.008764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.009196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.150000 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:18.150379 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=30 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:18.159019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-859c3c38-3d18-49fb-a394-e8f04295994b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.162960 May 23 18:11:18.159588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 266/482] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:17 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:18.325044 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=88 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:18.344322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:18.344835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:18.346680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=8 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:18.347461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:18.353320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.353797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.354585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.355076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.501146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:18.512387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2f184e1c-5b3b-49aa-abcd-820782e301b5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.172439 May 23 18:11:18.513705 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 267/483] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:18 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:18.536270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:18.537059 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:18.543270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.543714 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.544489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.544914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.711414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:18.741675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c297e27-b865-4561-82d9-896b4bfdd47b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.208840 May 23 18:11:18.743797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 268/484] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:18 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:18.760085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:18.761322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:18.793375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.795013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.803147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:18.803147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:18.875263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:18.883055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c8421485-6a6b-43ec-ab99-2f09cb996c0b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.137980 May 23 18:11:18.883623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 269/485] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:18 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:18.996045 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:18.996647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:19.003636 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.004064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.004821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.005243 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.150362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:19.158313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-54672794-a3d1-4e09-aa0e-887644e03a97 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.165996 May 23 18:11:19.158909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 270/486] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:18 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:19.177128 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:19.177650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:19.183941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.184398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.185872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.186458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.321934 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:19.329354 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-436c44c8-9cfa-42b0-9e45-261db87f07e8 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.156315 May 23 18:11:19.329908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 271/487] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:19 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:19.530527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:19.531177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:19.537191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.537635 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.538390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.538862 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.666103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:19.674225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0e3eb480-5490-4a49-be83-e1b248c06fb5 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.148250 May 23 18:11:19.674801 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 272/488] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:19 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:19.758994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:19.759599 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:19.765595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.766042 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.766862 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.767297 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.894823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:19.902177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e4bf6cc2-77a8-47a6-953d-776b708d05cc tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.147182 May 23 18:11:19.902737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 273/489] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:19 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:19.907633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:19.908234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:19.914003 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.914445 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.915237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:19.915671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:19.976078 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:19.983737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b870df3f-7719-4cdb-b951-282eaac5cba2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.080025 May 23 18:11:19.984314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 274/490] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:19 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:20.175343 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:20.176166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:20.182857 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.183303 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:20.184057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.184488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:20.310322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:20.317667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c72f1b82-2824-4e2e-90df-70c6d932c456 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.146188 May 23 18:11:20.318212 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 275/491] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:20 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:20.345495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:20.346087 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:20.351840 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.352291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:20.353037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.353552 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:20.681907 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:20.691299 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-209c732b-637e-4d8b-adcc-d70ef0688c08 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.348989 May 23 18:11:20.691913 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 276/492] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:20 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:20.697041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:20.697648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:20.704038 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.704483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:20.705239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.705675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:20.837320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:20.845272 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-48429c6c-f9be-4efb-bd29-7b43b08acaa4 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.152229 May 23 18:11:20.845822 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 277/493] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:20 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:20.919228 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:20.919866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:20.925635 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.926073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:20.926878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:20.927305 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.056378 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:21.064465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6d17e86d-dbba-47ae-bcb0-2bbd65571ede tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.148965 May 23 18:11:21.065045 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 278/494] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:20 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:21.069377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:21.069978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:21.076334 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.076782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.077588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.078210 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.139202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:21.146600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e01c1194-ad68-47ad-949e-3df02ed539ba tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.080608 May 23 18:11:21.147191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 279/495] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:21 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:21.334970 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:21.335497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:21.341649 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.342095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.342881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.343314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.347211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:21.472627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:21.479950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2412e9ff-7c37-4604-8522-2a4deac76822 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1314 microversion: 2.1 time: 0.148849 May 23 18:11:21.480496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 280/496] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:21 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:21.708465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:21.709071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:21.715348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.715827 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.716612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.717044 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.843838 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:21.851193 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e0416c56-eece-4207-a7fa-29466966b347 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.146572 May 23 18:11:21.851755 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 281/497] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:21 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:21.861292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:21.861894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:21.867582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.868033 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.868782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:21.869215 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:21.993244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:22.000600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0b2fa9f-51bb-478a-859c-617841faf522 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.142784 May 23 18:11:22.001166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 282/498] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:21 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:22.081063 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:22.081674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:22.087677 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.088127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:22.088883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.089317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:22.245332 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:22.269029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-457f0431-c0c4-49bb-afbc-c116a8800b84 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.180601 May 23 18:11:22.274480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 283/499] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:22 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:22.292653 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:22.295235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:22.308775 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.309225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:22.312049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.312049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:22.430195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:22.437879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b9d5d8d5-6dba-403e-b2fb-f6e159866a5a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1145 microversion: 2.1 time: 0.162176 May 23 18:11:22.438444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 284/500] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:22 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1145 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:22.497344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:22.497895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:22.504113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.504549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:22.505308 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.505747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:22.734053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:22.742427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-986b4904-2237-4e85-beca-2bba635d0a64 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1498 microversion: 2.1 time: 0.248956 May 23 18:11:22.743025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 285/501] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:22 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:22.869665 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:22.870272 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:22.882636 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.883236 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:22.883998 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:22.884426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.022396 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1322fb65-0da4-405d-9c2f-3e8ec8856f7c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "POST /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.899076 May 23 18:11:23.027582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 217/502] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:11:08 2022] POST /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d/os-volume_attachments => generated 194 bytes in 14901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:23.029213 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:23.030036 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:23.048926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.049633 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.050727 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.051408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.205960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:23.219247 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b1d7dd02-715c-4574-9233-822acad8d88c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.352673 May 23 18:11:23.220966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 286/503] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:22 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:23.241311 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:23.249931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fdec7cd7-b083-4cba-a99e-564da17bfb4a tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.225425 May 23 18:11:23.250988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 218/504] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:23 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:23.287960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:23.288581 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:23.298367 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.299072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.300753 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.301371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.341082 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:23.342052 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:23.349119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.349648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.350553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.351062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.384436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:11:23.499612 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-886b0fc0-5e25-470c-ae6e-3dc1bdaa0b83 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 204 len: 0 microversion: 2.1 time: 0.162219 May 23 18:11:23.500593 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 219/505] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:11:23 2022] DELETE /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:11:23.511387 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-d71530b9-8ed0-401a-bb78-2d2cb6e9e307 req-6a0311a2-9679-4359-8268-38268aa1dcdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c5bdee-1834-416c-a8e0-64858b483964", "tag": "c97baa91-db27-4da5-963a-92d5ba833cb0"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:23.528908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-d71530b9-8ed0-401a-bb78-2d2cb6e9e307 req-6a0311a2-9679-4359-8268-38268aa1dcdf service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.529566 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-d71530b9-8ed0-401a-bb78-2d2cb6e9e307 req-6a0311a2-9679-4359-8268-38268aa1dcdf service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.541323 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-d71530b9-8ed0-401a-bb78-2d2cb6e9e307 req-6a0311a2-9679-4359-8268-38268aa1dcdf service nova] Creating event network-changed:c97baa91-db27-4da5-963a-92d5ba833cb0 for instance 62c5bdee-1834-416c-a8e0-64858b483964 on hv-cinder-75078 May 23 18:11:23.547461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-d71530b9-8ed0-401a-bb78-2d2cb6e9e307 req-6a0311a2-9679-4359-8268-38268aa1dcdf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045125 May 23 18:11:23.548436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 220/506] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:23.549024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:23.553445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:23.554145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:23.556926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-099b2342-c79e-47fa-b99d-a71630134223 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.273973 May 23 18:11:23.557711 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 287/507] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:23 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:23.562345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.563127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.563241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:23.563755 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:23.564309 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.564844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.569814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.570265 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.571062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:23.571497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:23.633014 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:23.641874 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8d61de2a-931d-4b78-9e4b-1d5e01750b52 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1201 microversion: 2.1 time: 0.092248 May 23 18:11:23.642554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 221/508] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:23 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:23.710108 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:23.717887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-58fa4c84-e436-4d16-9ae5-34b8ca39cd5c tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1504 microversion: 2.1 time: 0.159411 May 23 18:11:23.718455 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 288/509] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:23 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:24.238683 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:24.239409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:24.245819 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.246267 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.247166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.247656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.267068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:24.267790 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:24.273737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.274183 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.274965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.275401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.386298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:24.394520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ac6528b-98b3-4996-8c66-9b2d695ed1c1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.159611 May 23 18:11:24.395139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 222/510] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:24 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:24.412359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:24.419763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-39df42c1-7e50-4ab9-9c86-611c7089e69b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.156483 May 23 18:11:24.420316 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 289/511] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:24 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:24.574405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:24.575540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:24.581617 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.582054 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.582823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.583253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.659666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:24.660268 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:24.666257 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.666707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.667464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.667887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.709762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:24.717865 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c0c2893-124f-4195-b153-2656a0fed19f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.147197 May 23 18:11:24.718618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 223/512] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:24 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:24.730345 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:24.734534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:24.735173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:24.739133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67dbe9c6-761b-467b-994b-0671eed90e2c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1201 microversion: 2.1 time: 0.083009 May 23 18:11:24.739953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 290/513] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:24 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1201 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:24.741319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.741767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.742523 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:24.742974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:24.873473 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:24.881142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c2354da8-08fd-4508-b80c-d1faedf5d618 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1504 microversion: 2.1 time: 0.150070 May 23 18:11:24.881715 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 224/514] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:24 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:25.412804 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:25.413410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:25.419871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.420317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.421064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.421492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.436863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:25.437498 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:25.443861 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.444306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.445056 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.445490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.551315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:25.558691 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1c896659-a48b-490b-9079-823b705fe1d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.150080 May 23 18:11:25.559391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 291/515] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:25 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:25.579091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:25.586339 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e713c648-b72b-486e-a93a-7b06c32d2ad2 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.154118 May 23 18:11:25.586919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 225/516] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:25 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:25.734682 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:25.735308 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:25.741222 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.741655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.742398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.742858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.756507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:25.757037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:25.764189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.764636 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.765389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.765820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.828532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:25.836041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c71a255f-a58f-4cf1-be48-3ecd2a7173bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1201 microversion: 2.1 time: 0.083642 May 23 18:11:25.836820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 226/517] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:25 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1201 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:25.873768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:25.881400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-21d91319-b9c3-494a-b2cb-df7f31d55885 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.150900 May 23 18:11:25.881948 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 292/518] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:25 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:25.898649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:25.899342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:25.905909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.906352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:25.907132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:25.907560 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.039196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:26.047512 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-caa4d972-400e-49ce-bb02-b0fd6c8b647d tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1504 microversion: 2.1 time: 0.152735 May 23 18:11:26.048064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 227/519] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:25 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:26.576113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:26.576650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:26.582629 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.583099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.583845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.584267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.602965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:26.603598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:26.610680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.611166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.611924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.612360 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.717369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:26.724994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6fbca421-8495-4b0d-9bd4-333d4c3579b0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.153082 May 23 18:11:26.725791 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 293/520] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:26 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:26.751912 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:26.760151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8ac9a137-4d1f-4342-93f8-4e56f490f3ba tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.161057 May 23 18:11:26.760814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 228/521] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:26 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:26.854060 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:26.854807 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:26.861900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.862450 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.863308 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.863807 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.898294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:26.899058 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:26.905608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.906059 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.907001 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:26.909329 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:26.928249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:26.936436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de68b118-776f-402a-8762-da231ad6db94 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1211 microversion: 2.1 time: 0.086757 May 23 18:11:26.937285 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 294/522] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:26 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:27.047393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:27.055655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-81e74e39-27dd-4970-a12f-ebd3ab247e1d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.161307 May 23 18:11:27.056209 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 229/523] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:26 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:27.064346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:27.064954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:27.070994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.071462 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:27.072211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.072645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:27.204558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:27.211969 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-779876e4-8bf0-40f4-ab89-f10d32580d18 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1504 microversion: 2.1 time: 0.151432 May 23 18:11:27.212521 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 295/524] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:27 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:27.741988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:27.742599 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:27.749557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.750057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:27.750903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.751344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:27.777261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:27.777804 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:27.785006 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.785445 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:27.786191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.786614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:27.886055 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:27.894490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-32c8ef41-36db-43e3-add6-906e4779bc5a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.156328 May 23 18:11:27.895100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 230/525] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:27 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:27.922413 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:27.925885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:27.930585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e7fdd41-cdd9-42ae-80c2-cc4dd4a23b47 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.157172 May 23 18:11:27.931166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 296/526] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:27 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:27.953742 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:27.954365 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:27.960294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.960753 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:27.961499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:27.961935 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.021581 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:28.029101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-930ecb53-4134-4f50-83bd-0c30e4e856c3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1211 microversion: 2.1 time: 0.079765 May 23 18:11:28.029595 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 231/527] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:27 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:28.072080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:28.072747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:28.079758 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.080202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.080965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.081403 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.229414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:28.230018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:28.236875 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.237315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.238100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.238502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.242507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:28.291349 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:28.299828 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-152e29f0-44c0-4b3a-ab0c-9bcf9cdb514b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.231509 May 23 18:11:28.300615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 297/528] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:28 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:28.375746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:28.383574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3280f4e6-c8d6-4834-8b1a-ad238758ee8b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1504 microversion: 2.1 time: 0.158095 May 23 18:11:28.384571 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 232/529] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:28 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:28.846776 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-f680f4bb-1884-4db2-892a-6966ac1a49ad req-9f71f6fb-1e13-4a61-9a48-58f0704fc826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161f981-61b7-4f97-b35e-9be65f749c3f", "name": "network-vif-plugged", "status": "completed", "tag": "a201ef56-1bfa-4d49-9aa4-dbef0f844919"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:28.854966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f680f4bb-1884-4db2-892a-6966ac1a49ad req-9f71f6fb-1e13-4a61-9a48-58f0704fc826 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.855504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f680f4bb-1884-4db2-892a-6966ac1a49ad req-9f71f6fb-1e13-4a61-9a48-58f0704fc826 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.868733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-f680f4bb-1884-4db2-892a-6966ac1a49ad req-9f71f6fb-1e13-4a61-9a48-58f0704fc826 service nova] Creating event network-vif-plugged:a201ef56-1bfa-4d49-9aa4-dbef0f844919 for instance 5161f981-61b7-4f97-b35e-9be65f749c3f on hv-cinder-75078 May 23 18:11:28.873774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-f680f4bb-1884-4db2-892a-6966ac1a49ad req-9f71f6fb-1e13-4a61-9a48-58f0704fc826 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 May 23 18:11:28.874307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 298/530] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:28.912518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:28.913227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:28.920001 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.920448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.921211 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.921658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.948233 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:28.948842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:28.956166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.956613 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:28.957391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:28.957820 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:29.051378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:29.058665 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cc86dfc6-f34f-4f92-8e2a-790ea5d4eeb9 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.150544 May 23 18:11:29.059441 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 233/531] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:28 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:29.064202 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:29.064808 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:29.070959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:29.071413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:29.072178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:29.072607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:29.097412 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:29.104917 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-456cf0e1-e713-43ab-b9ce-7b3bd4367f94 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.160834 May 23 18:11:29.105483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 299/532] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:28 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:29.140846 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:29.148251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5ab15eea-558d-43e9-8d10-2a15749a7f71 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1211 microversion: 2.1 time: 0.087849 May 23 18:11:29.148804 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 234/533] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:29 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:29.316172 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:29.316781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:29.323012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:29.323456 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:29.324211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:29.324638 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:29.401294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:29.402333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:29.410469 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:29.411216 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:29.425112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:29.426013 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:29.545721 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:29.556158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7eb00193-b5a9-4629-9071-ba8ddc32dd8e tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1370 microversion: 2.1 time: 0.243328 May 23 18:11:29.557940 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 300/534] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:29 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:29.641386 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:29.652731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9160fc3a-d5f2-4532-9968-c2c9982fd82f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1504 microversion: 2.1 time: 0.255471 May 23 18:11:29.653873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 235/535] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:29 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:30.078370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:30.079667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:30.092507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.093234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.094329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.094933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.123243 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:30.124581 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:30.132292 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.133121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.134118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.135320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.359640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:30.367341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f54d4c37-92d0-42fa-a510-cf9f41b25e54 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.294749 May 23 18:11:30.368496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 301/536] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:30 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:30.377192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:30.378217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:30.385846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.386373 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.388276 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.388903 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.432343 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:30.440936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b2a4ada9-e884-498f-af25-adc90c0fd13f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.323317 May 23 18:11:30.441950 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 236/537] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:30 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:30.575668 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:30.576574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:30.583130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.583578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.584346 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.585009 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.633559 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:30.644196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-389155f5-9565-472c-80ff-3a12784844c9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.274092 May 23 18:11:30.650109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 302/538] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:30 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:30.675195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:30.676931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:30.684741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.685700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.687382 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.688070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.770596 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:30.781009 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c76f5980-28a0-46a7-bd3d-a0f4d1882827 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1462 microversion: 2.1 time: 0.109607 May 23 18:11:30.781768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 303/539] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:30 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:30.791203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:30.797276 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-c723c256-7079-4db3-bf35-f14056e1b037 req-4418cefd-8e53-43db-8ae8-18797e2a351c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69c757e-08bd-4a68-91ec-ce0fbad018ad", "name": "network-vif-deleted", "tag": "ee02749d-1d0e-478e-ad90-83c15e48c971"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:30.800329 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b387fa8d-e9a5-40aa-acbd-c4be9011a7c6 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1564 microversion: 2.1 time: 0.229683 May 23 18:11:30.800901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 237/540] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:30 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:30.819134 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c723c256-7079-4db3-bf35-f14056e1b037 req-4418cefd-8e53-43db-8ae8-18797e2a351c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.819769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c723c256-7079-4db3-bf35-f14056e1b037 req-4418cefd-8e53-43db-8ae8-18797e2a351c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.821882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a7d80dd7-d46c-4139-b8e4-a9e50f5f9cf2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:30.822399 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a7d80dd7-d46c-4139-b8e4-a9e50f5f9cf2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:30.830362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d80dd7-d46c-4139-b8e4-a9e50f5f9cf2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.830985 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d80dd7-d46c-4139-b8e4-a9e50f5f9cf2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.831866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d80dd7-d46c-4139-b8e4-a9e50f5f9cf2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:30.832201 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d80dd7-d46c-4139-b8e4-a9e50f5f9cf2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:30.833349 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-c723c256-7079-4db3-bf35-f14056e1b037 req-4418cefd-8e53-43db-8ae8-18797e2a351c service nova] Creating event network-vif-deleted:ee02749d-1d0e-478e-ad90-83c15e48c971 for instance e69c757e-08bd-4a68-91ec-ce0fbad018ad on hv-cinder-75078 May 23 18:11:30.839413 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-c723c256-7079-4db3-bf35-f14056e1b037 req-4418cefd-8e53-43db-8ae8-18797e2a351c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047679 May 23 18:11:30.840178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 304/541] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:30.930601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a7d80dd7-d46c-4139-b8e4-a9e50f5f9cf2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114621 May 23 18:11:30.931587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 238/542] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:11:30 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:11:31.217782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-fe274188-0a8a-4f95-862c-97defd0a73d7 req-cd500497-8b21-4d05-8ed1-5d23517eefa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38d8037-09eb-4c41-b6d8-7a2126321b0b", "tag": "cfcde4fb-a3d1-4e66-a4ca-3d5933501427"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:31.227025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-fe274188-0a8a-4f95-862c-97defd0a73d7 req-cd500497-8b21-4d05-8ed1-5d23517eefa5 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.227609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-fe274188-0a8a-4f95-862c-97defd0a73d7 req-cd500497-8b21-4d05-8ed1-5d23517eefa5 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.242552 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-fe274188-0a8a-4f95-862c-97defd0a73d7 req-cd500497-8b21-4d05-8ed1-5d23517eefa5 service nova] Creating event network-changed:cfcde4fb-a3d1-4e66-a4ca-3d5933501427 for instance d38d8037-09eb-4c41-b6d8-7a2126321b0b on hv-cinder-75078 May 23 18:11:31.248821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-fe274188-0a8a-4f95-862c-97defd0a73d7 req-cd500497-8b21-4d05-8ed1-5d23517eefa5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035979 May 23 18:11:31.250014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 305/543] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:31.388182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:31.397962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:31.405525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.405980 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.406796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.407242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.459131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:31.459908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:31.467156 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.467738 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.468609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.469171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.554367 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:31.563074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-def0369b-8ef7-4bbd-a616-8cc7c5a9a28a tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.180394 May 23 18:11:31.563831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 239/544] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:31 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:31.660814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:31.661532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:31.667564 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.668027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.669820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.670538 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.784991 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:31.793731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-837cda41-dd98-40b4-8117-5ed2b0fc2be1 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.338745 May 23 18:11:31.802654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 306/545] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:31 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:31.802654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:31.802654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:31.805647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.806088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.806862 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:31.807288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:31.812554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:31.820462 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-16d18838-7446-4fc5-929b-a8e363778424 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.163303 May 23 18:11:31.821380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 240/546] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:31 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:31.895172 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:31.902601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-566ceb36-561a-42f0-9945-b33ef2915188 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1462 microversion: 2.1 time: 0.106988 May 23 18:11:31.903311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 307/547] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:31 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:32.579943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:32.580560 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:32.587118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.587567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:32.588357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.588789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:32.725723 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:32.736710 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-55da2e43-cf97-4b25-b513-78851a25d739 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.160724 May 23 18:11:32.737298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 241/548] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:32 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:32.810356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:32.811108 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:32.817356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.817817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:32.818563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.819043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:32.838131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:32.838962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:32.845963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.846483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:32.847364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.847884 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:32.959077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:32.967539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0bd98a93-373e-449d-8cf3-0886fdba921c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.161482 May 23 18:11:32.968393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 308/549] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:32 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:32.972599 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:32.973202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:32.979177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.980095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:32.980441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:32.980823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:33.003062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:33.011194 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e14a73dd-d8da-47f3-addf-a1f6814f7470 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.177719 May 23 18:11:33.011769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 242/550] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:32 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:33.044105 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:33.051650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a6d1bac-0926-4092-a7ee-bc34ffab2bf5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1462 microversion: 2.1 time: 0.082593 May 23 18:11:33.052206 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 309/551] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:32 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:33.523330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-e3589e99-42f3-439f-8ec4-9e9561309f04 req-be49656f-f938-4fa7-bb04-39c007d383c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af994d05-2cb5-4804-ac2c-46d19e2d04b1", "tag": "3e5629ff-ce51-43da-9392-add0febcff5b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:33.530662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e3589e99-42f3-439f-8ec4-9e9561309f04 req-be49656f-f938-4fa7-bb04-39c007d383c4 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:33.531144 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e3589e99-42f3-439f-8ec4-9e9561309f04 req-be49656f-f938-4fa7-bb04-39c007d383c4 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:33.546413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-e3589e99-42f3-439f-8ec4-9e9561309f04 req-be49656f-f938-4fa7-bb04-39c007d383c4 service nova] Creating event network-changed:3e5629ff-ce51-43da-9392-add0febcff5b for instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 on hv-cinder-75078 May 23 18:11:33.551717 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-e3589e99-42f3-439f-8ec4-9e9561309f04 req-be49656f-f938-4fa7-bb04-39c007d383c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049758 May 23 18:11:33.552317 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 243/552] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:33.753736 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:33.754270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:33.760641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:33.761091 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:33.761842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:33.762579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:33.890133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:33.897710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f6deac67-e210-45a6-be36-dff8d3008d53 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.147825 May 23 18:11:33.898303 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 310/553] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:33 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:33.987078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:33.987768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:33.994422 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:33.994907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:33.995663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:33.996099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.029065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:34.029726 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:34.035794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.036264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.037016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.037450 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.205894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:34.223847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c4c3eb9-1f21-474e-82f3-2d6c227b987c tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1315 microversion: 2.1 time: 0.240874 May 23 18:11:34.228010 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 244/554] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:33 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:34.237260 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:34.238657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:34.246455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.247952 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.248796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.249236 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.271883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:34.285279 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a004af66-1cc3-4e7a-9eee-ad7ee8839da7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.259835 May 23 18:11:34.286336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 311/555] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:34 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:34.291345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.292049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.292502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lazy-loading 'fault' on Instance uuid e69c757e-08bd-4a68-91ec-ce0fbad018ad {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:34.296042 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6f586a94-9ae0-465a-ba3f-c512d2ae8241 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:34.297292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6f586a94-9ae0-465a-ba3f-c512d2ae8241 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:34.306262 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f586a94-9ae0-465a-ba3f-c512d2ae8241 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.307988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f586a94-9ae0-465a-ba3f-c512d2ae8241 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.308792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f586a94-9ae0-465a-ba3f-c512d2ae8241 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.309850 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f586a94-9ae0-465a-ba3f-c512d2ae8241 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.339858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6f586a94-9ae0-465a-ba3f-c512d2ae8241 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/ips" status: 200 len: 145 microversion: 2.1 time: 0.051225 May 23 18:11:34.340475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 312/556] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:11:34 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:34.386568 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:34.395146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93c8087b-af2b-4a1c-9913-fa9bb9940efa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1304 microversion: 2.1 time: 0.164358 May 23 18:11:34.395470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 245/557] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:34 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:34.916946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:34.917643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:34.924294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.924742 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:34.925756 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:34.927503 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.062623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:35.069995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7fdbf74d-f1ce-406c-afd2-a65b1a1c77a7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.158437 May 23 18:11:35.076951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 313/558] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:34 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:35.245270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:35.245872 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:35.252443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.252883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.253633 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.254058 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.301962 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:35.302717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:35.309572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.310244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.311280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.311721 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.393314 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:35.408717 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e542f065-c7f1-4a41-96ac-cea96f6f65fd tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1464 microversion: 2.1 time: 0.166991 May 23 18:11:35.410132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 246/559] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:35 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:35.415218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:35.416157 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:35.423674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.424584 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.426431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.427099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.467845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.468638 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.469400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lazy-loading 'fault' on Instance uuid e69c757e-08bd-4a68-91ec-ce0fbad018ad {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:35.548298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:35.558474 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a42bae6-3e63-45a4-8238-49023b70604f tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 200 len: 1304 microversion: 2.1 time: 0.146969 May 23 18:11:35.563790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 247/560] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:35 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:35.570858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:35.583230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-900b63f5-db22-4128-aad1-f15e92248c62 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.285097 May 23 18:11:35.586188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 314/561] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:35 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:35.586730 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:35.587476 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:35.593886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.594523 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.595509 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.595943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.623340 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:11:35.637558 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:35.700027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04a0fa02-7394-4b40-a6d8-faaed6ae7e5e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 204 len: 0 microversion: 2.1 time: 0.134906 May 23 18:11:35.700604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 248/562] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:11:35 2022] DELETE /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:11:35.708676 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:35.709352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:35.715205 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.715861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.717112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:35.717618 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:35.874404 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:35.879577 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:35.886881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d9a703a9-8024-4d7a-a745-0e04acfdf3e7 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1470 microversion: 2.1 time: 0.181818 May 23 18:11:35.888904 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 315/563] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:35 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:36.089455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:36.090293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:36.096708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.097155 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:36.097917 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.098349 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:36.225065 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:36.232775 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3154badb-ae8d-473a-8c99-e594e017f2e0 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.148132 May 23 18:11:36.233336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 249/564] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:36 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:36.577578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:36.578180 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: e69c757e-08bd-4a68-91ec-ce0fbad018ad] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:36.584125 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.584565 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:36.585307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.585731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:36.599084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] HTTP exception thrown: Instance e69c757e-08bd-4a68-91ec-ce0fbad018ad could not be found. May 23 18:11:36.600312 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Request method failure captured: May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad HTTP/1.1 May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii84iou9_XBe1r4S2HVJ_t19e7qXs-eFmqgx4UB3vvFZKxEZBpld73hSmA5vGEzxThlSRII-Emewo2YeG7lehHx5LUlpZXyU9gpy3HNA_xx8wKkgqGzVvIHH_dHu2vutPIvOBi5jwcFOd0GPDmO_JNhnEFFXHd9Qna3WPaAxHjjC3fyM May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: c743c4e622a84f7e9a2bf858b3a164fe May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesActionsTest-1949718339 May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:11:36.600771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesActionsTest-1949718339 May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: c743c4e622a84f7e9a2bf858b3a164fe May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesActionsTest-1949718339 May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesActionsTest-1949718339-project May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 7ca87844c7ef4b2da0a12915aeff81a0 May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesActionsTest-1949718339-project May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance e69c757e-08bd-4a68-91ec-ce0fbad018ad could not be found. May 23 18:11:36.602301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'e69c757e-08bd-4a68-91ec-ce0fbad018ad'} May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69c757e-08bd-4a68-91ec-ce0fbad018ad could not be found. May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:11:36.603166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69c757e-08bd-4a68-91ec-ce0fbad018ad could not be found. May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69c757e-08bd-4a68-91ec-ce0fbad018ad could not be found. May 23 18:11:36.604608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:11:36.606951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:36.607030 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Returning 404 to user: Instance e69c757e-08bd-4a68-91ec-ce0fbad018ad could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:11:36.607030 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5191c1bb-88fc-4226-9916-3b4e18deeb76 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad" status: 404 len: 111 microversion: 2.1 time: 0.028598 May 23 18:11:36.607030 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 316/565] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:36 2022] GET /compute/v2.1/servers/e69c757e-08bd-4a68-91ec-ce0fbad018ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:11:36.608318 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.608769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:36.609536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.609971 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:36.655196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1994459238", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "networks": [{"uuid": "2c6e3be5-c742-460e-a98b-5e7f1f8e7c51"}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:36.661794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:36.709013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] validate_networks() for [('2c6e3be5-c742-460e-a98b-5e7f1f8e7c51', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:11:36.751606 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:36.759664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-332baddb-a3f9-44ef-8388-9b1d2f9675e0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.163045 May 23 18:11:36.760530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 250/566] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:36 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:36.907569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:36.911146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:36.917894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.922038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:36.922943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:36.923373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.068621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:37.076503 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ed3d28df-dc70-44a2-8158-306c5676054d tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1470 microversion: 2.1 time: 0.173845 May 23 18:11:37.077073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 251/567] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:36 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:37.086016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ef0ba17-237d-4579-a522-ef083bc90bfd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a78771e7-a652-4f3d-a6ed-dc1f51132b6c"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:37.086016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ef0ba17-237d-4579-a522-ef083bc90bfd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:37.089494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:11:37.089647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef0ba17-237d-4579-a522-ef083bc90bfd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.090588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:11:37.090899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef0ba17-237d-4579-a522-ef083bc90bfd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.091179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:11:37.091615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:11:37.091761 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef0ba17-237d-4579-a522-ef083bc90bfd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.092023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:11:37.092145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef0ba17-237d-4579-a522-ef083bc90bfd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.100776 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.101217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.102006 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.102438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.119322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Getting quotas for project c743c4e622a84f7e9a2bf858b3a164fe. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:11:37.123445 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Getting quotas for user 7ca87844c7ef4b2da0a12915aeff81a0 and project c743c4e622a84f7e9a2bf858b3a164fe. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:11:37.134582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:11:37.137687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:11:37.185478 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c787591-7a36-4de0-8013-c4178703fc5a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534518 May 23 18:11:37.186118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 317/568] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 18:11:37.191698 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-b2b8eb8e-f412-4551-aba2-f4044e56cf0c req-9b048c24-1156-4dfa-ac33-c9339374f7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c5bdee-1834-416c-a8e0-64858b483964", "name": "network-vif-plugged", "status": "completed", "tag": "c97baa91-db27-4da5-963a-92d5ba833cb0"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:37.200089 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b2b8eb8e-f412-4551-aba2-f4044e56cf0c req-9b048c24-1156-4dfa-ac33-c9339374f7b0 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.200531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b2b8eb8e-f412-4551-aba2-f4044e56cf0c req-9b048c24-1156-4dfa-ac33-c9339374f7b0 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.211553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-b2b8eb8e-f412-4551-aba2-f4044e56cf0c req-9b048c24-1156-4dfa-ac33-c9339374f7b0 service nova] Creating event network-vif-plugged:c97baa91-db27-4da5-963a-92d5ba833cb0 for instance 62c5bdee-1834-416c-a8e0-64858b483964 on hv-cinder-75078 May 23 18:11:37.216487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-b2b8eb8e-f412-4551-aba2-f4044e56cf0c req-9b048c24-1156-4dfa-ac33-c9339374f7b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029162 May 23 18:11:37.217347 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 318/569] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:37.222390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b1dd135-013d-4fd7-a1ec-77b1b22e8a36 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:37.223114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9b1dd135-013d-4fd7-a1ec-77b1b22e8a36 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:37.276049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9b1dd135-013d-4fd7-a1ec-77b1b22e8a36 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:37.282951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b1dd135-013d-4fd7-a1ec-77b1b22e8a36 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1214 microversion: 2.1 time: 0.064417 May 23 18:11:37.283537 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 319/570] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:37 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:37.292407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:37.292407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:37.294995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.295447 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.296197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.296628 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.522088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:37.531845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-71832029-b6fd-4bb3-9613-3d44a3f48dd1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.247255 May 23 18:11:37.533048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 320/571] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:37 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:37.776745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:37.777344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:37.783720 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.784163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.784908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:37.785333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:37.913988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:37.937772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-66e0ada9-f055-4992-9a06-46438061152e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.162997 May 23 18:11:37.939350 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 321/572] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:37 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:38.093703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:38.096315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:38.103507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.104141 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.105011 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.106234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.286560 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ef0ba17-237d-4579-a522-ef083bc90bfd tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.205995 May 23 18:11:38.292864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 252/573] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:11:37 2022] POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-volume_attachments => generated 194 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:38.306180 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:38.309873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:38.332714 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.334347 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.337594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.339256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.450915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:38.460318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aa0881d2-3ea9-41c2-93d6-156701c59b84 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1470 microversion: 2.1 time: 0.369414 May 23 18:11:38.461452 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 322/574] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:38 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:38.545807 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:38.549716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:38.550329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:38.555796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0f23c7f3-8356-4c21-8082-b2ae9d4b7be6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1266 microversion: 2.1 time: 0.259308 May 23 18:11:38.556368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 253/575] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:38 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:38.557440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.557907 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.558681 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.559762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.693813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:38.702792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-06f97b6f-ed21-443c-8dd8-dc097d312552 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.157046 May 23 18:11:38.703368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 323/576] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:38 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:38.916305 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-6cb25145-a6d3-420b-9624-d778c45589ac req-f032fb6a-6d86-4df5-a1c6-10a0d8f73af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161f981-61b7-4f97-b35e-9be65f749c3f", "name": "network-vif-deleted", "tag": "a201ef56-1bfa-4d49-9aa4-dbef0f844919"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:38.929071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6cb25145-a6d3-420b-9624-d778c45589ac req-f032fb6a-6d86-4df5-a1c6-10a0d8f73af8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.929526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6cb25145-a6d3-420b-9624-d778c45589ac req-f032fb6a-6d86-4df5-a1c6-10a0d8f73af8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.941601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-6cb25145-a6d3-420b-9624-d778c45589ac req-f032fb6a-6d86-4df5-a1c6-10a0d8f73af8 service nova] Creating event network-vif-deleted:a201ef56-1bfa-4d49-9aa4-dbef0f844919 for instance 5161f981-61b7-4f97-b35e-9be65f749c3f on hv-cinder-75078 May 23 18:11:38.946518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-6cb25145-a6d3-420b-9624-d778c45589ac req-f032fb6a-6d86-4df5-a1c6-10a0d8f73af8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033934 May 23 18:11:38.947118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 254/577] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:38.955663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:38.956264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:38.962388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.962865 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:38.963631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:38.964039 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:39.120108 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:39.127843 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-432adf74-8e82-4129-9b70-512d72518381 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1279 microversion: 2.1 time: 0.175987 May 23 18:11:39.128467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 324/578] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:38 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:39.477496 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:39.478181 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:39.485178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:39.485618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:39.486367 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:39.486823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:39.554785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:39.562567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fd186946-c9ed-4bdb-b3aa-f433314e5bc6 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1300 microversion: 2.1 time: 0.089188 May 23 18:11:39.563145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 255/579] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:39 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:39.573176 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:39.573813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:39.580333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:39.580778 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:39.581525 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:39.581955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:39.646718 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:39.657058 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-41adfbe9-6233-4274-bee2-2e8b58b1f7a5 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1266 microversion: 2.1 time: 0.087520 May 23 18:11:39.663605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 325/580] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:39 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:39.720865 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:39.720865 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:39.730102 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:39.731049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:39.732118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:39.732552 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:39.961100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:39.968456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-daaefc5d-c456-4060-8543-eea8c254ee8e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.253206 May 23 18:11:39.969010 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 256/581] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:39 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:40.094067 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e1998ba1-664a-4880-88c5-ea3ac2d3cf1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:40.094617 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e1998ba1-664a-4880-88c5-ea3ac2d3cf1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:40.100440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1998ba1-664a-4880-88c5-ea3ac2d3cf1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.100888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1998ba1-664a-4880-88c5-ea3ac2d3cf1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.101666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1998ba1-664a-4880-88c5-ea3ac2d3cf1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.102099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1998ba1-664a-4880-88c5-ea3ac2d3cf1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.125867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e1998ba1-664a-4880-88c5-ea3ac2d3cf1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/ips" status: 200 len: 151 microversion: 2.20 time: 0.035936 May 23 18:11:40.126427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 326/582] 10.222.0.30 () {60 vars in 1288 bytes} [Mon May 23 18:11:40 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:11:40.144736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:40.145486 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:40.151435 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.151894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.152847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.153439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.290637 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:40.298876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-40b8394d-af11-49d2-9e10-e23acb3c904e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.157863 May 23 18:11:40.299483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 257/583] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:40 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:40.579217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:40.579847 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:40.585885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.586323 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.587099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.587534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.618037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.618479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.618950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:40.661446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:40.669572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-986d2020-d4bc-447f-80ce-70ae71113595 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.094191 May 23 18:11:40.670211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 327/584] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:40 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:40.675335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:40.675941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:40.682337 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.682821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.683582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.684311 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.745182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:40.752563 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ea0434d3-f682-4fc6-9a10-51fb35b6bfbb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1284 microversion: 2.1 time: 0.081048 May 23 18:11:40.753123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 258/585] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:40 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:40.985577 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:40.986100 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:40.992139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.992584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:40.993330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:40.993758 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.129013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:41.137878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-deab15d8-f6fb-4a22-b482-a46c923b6448 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.156310 May 23 18:11:41.138509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 328/586] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:40 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:41.316083 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:41.316691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:41.319696 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:41.323764 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:41.324209 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.325649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:41.326078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.463632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:41.471472 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7482fa0d-991f-441f-8d22-19d2ce65cd38 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.159168 May 23 18:11:41.472038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 259/587] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:41 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:41.686670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:41.687308 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:41.693297 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:41.693738 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.694494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:41.694955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.723595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:41.724041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.724509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:41.764737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:41.768691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:41.769299 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:41.772098 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db0838b0-dd83-4d6c-843b-673cf5baaa66 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.090035 May 23 18:11:41.772654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 329/588] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:41 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:41.775732 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:41.776178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.776935 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:41.777436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:41.842023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:41.849463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fdadfd5c-aa04-45af-b2e4-4ee6d0de503e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1284 microversion: 2.1 time: 0.084543 May 23 18:11:41.850020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 260/589] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:41 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:42.155631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:42.156267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:42.162184 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.162630 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.163415 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.163846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.488581 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:42.489401 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:42.495492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.495947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.496793 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.497461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.504223 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:42.520251 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b77fe1d-8682-4163-8bd7-e38bbcf93d64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1358 microversion: 2.1 time: 0.368918 May 23 18:11:42.520931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 330/590] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:42 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1358 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:42.638891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:42.647761 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-851486d6-616b-4ea0-8460-89cf11232cab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.163012 May 23 18:11:42.648324 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 261/591] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:42 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:42.788840 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:42.789449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:42.795629 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.796071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.796821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.797252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.827683 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.828062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.828503 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:42.866650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:42.867287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:42.867696 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:42.874424 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.874899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.875642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3206d10d-b888-441f-af06-60c0b70fb65e tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.090653 May 23 18:11:42.875740 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:42.876087 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:42.876202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 331/592] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:42 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:42.940183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:42.948057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-70b6baef-9db8-45e8-b503-17398baa7dcb tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1272 microversion: 2.1 time: 0.085208 May 23 18:11:42.948611 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 262/593] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:42 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:43.537244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:43.537874 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:43.544957 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.545334 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.545992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.546415 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.665502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:43.666418 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:43.675112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.675897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.677301 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.678039 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.685334 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:43.693123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fddad98d-a5e4-4812-98ec-4535e62646c7 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1549 microversion: 2.1 time: 0.159720 May 23 18:11:43.693755 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 332/594] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:43 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:43.698188 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:43.709985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:43.710527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:43.717210 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.717663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.718427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.718892 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.816551 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:43.823915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eae7f317-d7d3-4097-bbe4-ffb9a17eabc9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.162331 May 23 18:11:43.825258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 263/595] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:43 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:43.846412 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:43.853868 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-811654da-f2b8-4cc2-92c7-36d744fc3b91 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1549 microversion: 2.1 time: 0.147786 May 23 18:11:43.854421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 333/596] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:43 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:43.869214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:43.873365 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:43.874117 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Searching by: {'deleted': False, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd'} {{(pid=117928) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 18:11:43.881392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.881827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.882604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.883063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.893271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:43.893981 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:43.900083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.900604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.901439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.901949 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.933170 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.934401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.934888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:43.937665 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:43.971673 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.multi_cell_list [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 18:11:43.975571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:43.983466 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-99f1e261-f8f4-4f2a-849a-29937cac9e8f tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.093992 May 23 18:11:43.984025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 334/597] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:43 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:43.988405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:43.989005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:43.994796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.995249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:43.996707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:43.997165 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:44.060198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:44.067713 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c4a9a151-e1b7-40ee-9330-430241ef0fb8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1272 microversion: 2.1 time: 0.082745 May 23 18:11:44.067962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dce927d7-2ff2-46f6-9697-58a953eba438 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202497 May 23 18:11:44.068273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 335/598] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:43 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:44.068533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 264/599] 10.222.0.30 () {58 vars in 1124 bytes} [Mon May 23 18:11:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:44.078803 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:44.079412 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:44.085295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:44.085745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:44.086532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:44.086990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:44.211235 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:44.218567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-568ea72d-a0fe-4ea0-a1c6-124ff5f7e3cf tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1549 microversion: 2.1 time: 0.143587 May 23 18:11:44.219158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 336/600] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:44 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1549 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:44.842323 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:44.842965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:44.848922 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:44.849370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:44.850118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:44.850549 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:44.979610 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:44.987181 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc0b52cc-90f5-4bfb-953d-38d36b8b3d75 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.149728 May 23 18:11:44.987743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 265/601] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:44 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:45.000568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:45.001149 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:45.007499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:45.007941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:45.008690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:45.009115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:45.039759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:45.040197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:45.040631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:45.081395 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:45.083653 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:45.084351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:45.089202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9f1b8c47-e01c-4092-bc20-8c29758e5107 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.093168 May 23 18:11:45.089762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 337/602] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:44 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:45.090506 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:45.091135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:45.091945 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:45.092384 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:45.152499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:45.159790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9ffcc98b-1292-415b-a622-f40c2f81d516 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1272 microversion: 2.1 time: 0.080153 May 23 18:11:45.160352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 266/603] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:45 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1272 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:46.006068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:46.006601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:46.012676 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.013125 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.013880 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.014315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.105696 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:46.107047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:46.113656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.114123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.114930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.115364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.144733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:46.146446 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.147165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.147614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:46.152374 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-53d149ba-cae7-455a-9131-d4296f7144ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.150473 May 23 18:11:46.158210 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 338/604] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:46 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:46.176561 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:46.177161 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:46.183086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.183524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.184272 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.184869 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.190383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:46.197896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6807a449-ef2d-479b-af53-f18b2ce8fc9b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.096018 May 23 18:11:46.198540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 267/605] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:46 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:46.245319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:46.253278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af0e74f1-8ba1-4cba-bc41-ccb0be968f8a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1272 microversion: 2.1 time: 0.080538 May 23 18:11:46.253825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 339/606] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:46 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:46.299124 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:46.299587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:46.305562 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.306004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.306806 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.307242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.330411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lazy-loading 'flavor' on Instance uuid ebec7dc8-9547-4dac-9035-078304c6793c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:46.584976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-051b4639-2643-4413-ae56-a8cea0bbc949 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/action" status: 202 len: 0 microversion: 2.20 time: 0.289673 May 23 18:11:46.588625 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 268/607] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 18:11:46 2022] POST /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 18:11:46.594389 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:46.595043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:46.601847 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.602384 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.603277 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:46.603781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:46.734161 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:46.742001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:46.743529 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:46.744658 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-27e75f39-9ff9-4c19-84bc-546f06a87cb5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.154858 May 23 18:11:46.745200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 340/608] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:46 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:47.170979 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:47.171676 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:47.177902 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.178351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.179144 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.179581 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.215339 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:47.216091 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:47.217929 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:47.223837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.224279 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.225038 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.225465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.257532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.257981 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.258429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:47.280414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=8 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:47.307726 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:47.316171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-582969e4-e9ed-4265-93e4-7d3d1b3560e3 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.104370 May 23 18:11:47.318903 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 341/609] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:47 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:47.323985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:47.324594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:47.331375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.331822 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.332591 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.333020 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.385553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:47.396328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:47.398325 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-817c4f2a-8758-411b-8e29-f67ff3341739 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.232053 May 23 18:11:47.399430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 269/610] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:47 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:47.407184 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-56928b94-09ac-418b-b83a-d59e90b27810 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1272 microversion: 2.1 time: 0.086806 May 23 18:11:47.407850 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 342/611] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:47 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:47.763569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:47.764175 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:47.770063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.770508 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.771302 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:47.771733 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:47.962155 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:47.970163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:47.971726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:47.972883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a144de2-e8b1-4e61-8fd7-00899828627a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.213361 May 23 18:11:47.973446 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 270/612] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:47 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:48.333451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:48.334052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:48.340701 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:48.341408 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:48.342193 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:48.342631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:48.372735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:48.373175 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:48.373613 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:48.413978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:48.415358 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:48.416327 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:48.421838 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-17f78bf6-431c-4ccd-b0fc-f31c6b513dac tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.092402 May 23 18:11:48.422401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 343/613] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:48 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:48.426782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:48.427386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:48.430657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:48.431143 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:48.431919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:48.432363 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:48.433444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:48.433923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:48.434900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:48.435271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:48.563499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:48.565704 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:48.570921 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d40e907f-c5c7-4c81-91ca-a8549c47098b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.147487 May 23 18:11:48.571488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 344/614] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:48 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:48.573061 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d8ff6b2-8ad4-4b4e-8b92-d686f05a1bb5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.161470 May 23 18:11:48.573608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 271/615] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:48 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:48.992592 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:48.993314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:49.000275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.000720 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.001562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.001996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.133048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:49.141724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:49.143280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:49.144427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc085c98-78cb-4c63-b290-92c9ac592a4c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.156159 May 23 18:11:49.144986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 345/616] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:48 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:49.439309 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:49.439831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:49.446281 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.446754 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.447520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.447958 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.477451 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.477897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.478342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lazy-loading 'fault' on Instance uuid 5161f981-61b7-4f97-b35e-9be65f749c3f {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:11:49.523253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b641e57278c40faa5d20ea1ef7154bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcac6234abb473aba962b7dc9e4a3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:49.531820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-998c22be-e0ee-4e67-961f-16b47c4a9a4b tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 200 len: 1305 microversion: 2.1 time: 0.096402 May 23 18:11:49.532394 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 272/617] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:49 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:49.589452 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:49.593476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:49.593620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:49.594129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:49.599790 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.600227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.601003 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.602085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.602541 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.603023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.603813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:49.604248 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:49.750594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:49.761963 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-553515ca-66fb-4ed2-8120-5337fd7e9da2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.176510 May 23 18:11:49.773662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 346/618] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:49 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:49.776419 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:49.785564 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-34a6dce8-8802-4c29-b03c-d67bebd3f259 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.198129 May 23 18:11:49.786506 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 273/619] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:49 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:50.163401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:50.164010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:50.171218 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.171668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.172431 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.172869 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.326402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:50.337074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:50.339401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:50.341217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-378003f8-6858-4673-a776-2d9a72de1388 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.181390 May 23 18:11:50.342144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 347/620] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:50 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:50.549487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:50.550102 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] [instance: 5161f981-61b7-4f97-b35e-9be65f749c3f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:50.556746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.557207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.557979 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.558423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.573147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] HTTP exception thrown: Instance 5161f981-61b7-4f97-b35e-9be65f749c3f could not be found. May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Request method failure captured: May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f HTTP/1.1 May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii84gJvVoiFXl-2WqvbIB7mO6p4qxpvRy2OzSNpRhlD_k11rmAUKJW92TNbREvl2S8gr1nB1mLBRTXHWLS4aXCiBOyveSDYTQ4TlbQQw4oMoxFdUhUe2B0ZDZdVb7i6Ti22ceKxP3gD_P0s3zy9eG7RhCg4DvLBZVcm_Vf1IXw4PzNbc May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: bfcac6234abb473aba962b7dc9e4a3c3 May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-1543534788 May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:11:50.575487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bfcac6234abb473aba962b7dc9e4a3c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bfcac6234abb473aba962b7dc9e4a3c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bfcac6234abb473aba962b7dc9e4a3c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bfcac6234abb473aba962b7dc9e4a3c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-1543534788 May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: bfcac6234abb473aba962b7dc9e4a3c3 May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-1543534788 May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-1543534788-project May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 2b641e57278c40faa5d20ea1ef7154bd May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-1543534788-project May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 5161f981-61b7-4f97-b35e-9be65f749c3f could not be found. May 23 18:11:50.576873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '5161f981-61b7-4f97-b35e-9be65f749c3f'} May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5161f981-61b7-4f97-b35e-9be65f749c3f could not be found. May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:11:50.578444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5161f981-61b7-4f97-b35e-9be65f749c3f could not be found. May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5161f981-61b7-4f97-b35e-9be65f749c3f could not be found. May 23 18:11:50.579708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:11:50.580765 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] Returning 404 to user: Instance 5161f981-61b7-4f97-b35e-9be65f749c3f could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:11:50.580765 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c46e9313-c2ab-48d1-8452-d03b95db18e0 tempest-VolumesNegativeTest-1543534788 tempest-VolumesNegativeTest-1543534788-project] 10.222.0.30 "GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f" status: 404 len: 111 microversion: 2.1 time: 0.031450 May 23 18:11:50.580765 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 274/621] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:50 2022] GET /compute/v2.1/servers/5161f981-61b7-4f97-b35e-9be65f749c3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:11:50.787241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:50.787241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:50.787241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.787241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.788448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.788448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.812226 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:50.812975 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:50.821211 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.821749 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.829192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:50.830018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:50.976315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:50.984623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ed1b9843-56f4-418b-a8f1-e84a11d40088 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.209234 May 23 18:11:50.985337 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 348/622] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:50 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:51.155927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:51.165048 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ad39a5b5-9d41-4e15-8d77-8e4fdfdb2e48 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.360341 May 23 18:11:51.165784 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 275/623] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:50 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:51.362326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:51.363421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:51.374196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:51.375993 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:51.376796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:51.377230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:51.418304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-dc05ddd3-44af-4ee9-a07d-f6d8db3e5dec req-66d073a7-8f69-4a7b-9f18-60444ce4334a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1561ef77-19e9-45a6-b5cc-85485e461f25", "tag": "6a95cca7-7db8-4776-96ff-62d047ad30ac"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:51.446499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dc05ddd3-44af-4ee9-a07d-f6d8db3e5dec req-66d073a7-8f69-4a7b-9f18-60444ce4334a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:51.447600 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dc05ddd3-44af-4ee9-a07d-f6d8db3e5dec req-66d073a7-8f69-4a7b-9f18-60444ce4334a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:51.462447 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-dc05ddd3-44af-4ee9-a07d-f6d8db3e5dec req-66d073a7-8f69-4a7b-9f18-60444ce4334a service nova] Creating event network-changed:6a95cca7-7db8-4776-96ff-62d047ad30ac for instance 1561ef77-19e9-45a6-b5cc-85485e461f25 on hv-cinder-75078 May 23 18:11:51.468466 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-dc05ddd3-44af-4ee9-a07d-f6d8db3e5dec req-66d073a7-8f69-4a7b-9f18-60444ce4334a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066892 May 23 18:11:51.469053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 276/624] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:11:51.599278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:51.609767 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:51.611332 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:51.612433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fbd11fd7-809a-478a-ad8e-353a8c0e6410 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.254020 May 23 18:11:51.615169 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 349/625] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:51 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:52.003085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:52.004638 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:52.011265 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.011711 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.012933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.013646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.120286 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-82cd3b58-b86b-42a8-a53f-edcfed775788 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b8d4952-56c9-418d-a641-22de9be838b4"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:11:52.121568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-82cd3b58-b86b-42a8-a53f-edcfed775788 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:52.130467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82cd3b58-b86b-42a8-a53f-edcfed775788 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.145049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82cd3b58-b86b-42a8-a53f-edcfed775788 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.145906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82cd3b58-b86b-42a8-a53f-edcfed775788 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.146340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82cd3b58-b86b-42a8-a53f-edcfed775788 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.174287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:52.281837 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:52.290177 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-12752c91-9bfa-4942-81a3-97dcae940da3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.292173 May 23 18:11:52.300168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 277/626] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:51 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:52.300168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:52.300168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:52.302311 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.302785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.303542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.303970 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.323378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:52.459099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:52.467268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e91ac01a-de2d-450e-97fb-33d63918ced4 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.175371 May 23 18:11:52.468205 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 278/627] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:52 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:52.631366 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:52.631976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:52.638438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.638924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.640406 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:52.640904 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:52.772224 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:52.781093 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:52.782584 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:52.783777 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b36135d1-49dc-41e1-a924-48f12b879d09 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.156500 May 23 18:11:52.784327 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 279/628] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:52 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:11:53.307079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:53.307684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:53.314667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:53.315145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:53.315908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:53.316604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:53.454846 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:53.459628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3f2d65fc-e13f-4797-ba04-b3dd6bb03b7b tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.156332 May 23 18:11:53.460182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 280/629] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:53 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:53.484242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:53.484860 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:53.491787 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:53.492238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:53.493156 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:53.493597 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:53.863023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:53.870370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0db92fce-9d31-47ac-bac8-8d193e9d0558 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.390199 May 23 18:11:53.870959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 281/630] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:53 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:53.875862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:53.876459 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:53.882258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:53.882725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:53.883479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:53.883914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:53.914057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:54.009751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:54.017814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:54.019352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:54.020507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e8039412-1d13-4726-8487-6e9874d17a16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.148069 May 23 18:11:54.021063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 282/631] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:53 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:54.476701 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:54.477353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:54.484208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:54.484652 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:54.485409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:54.485844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:54.617852 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:54.625314 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-61f8f490-be8e-4015-bf26-c1ce0deec252 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.152409 May 23 18:11:54.626024 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 283/632] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:54 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:54.893177 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:54.894273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:54.906555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:54.907331 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:54.908618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:54.909346 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:55.073139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:55.081579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-94ee153d-8462-40cc-9ce1-7069bb42e655 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.196431 May 23 18:11:55.082136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 284/633] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:54 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:55.086512 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:55.087132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:55.093197 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:55.093642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:55.094397 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:55.094861 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:55.221794 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:55.229600 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:55.231851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:55.233000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5cdffc12-681b-4953-9235-fdb4fab93795 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.149951 May 23 18:11:55.233551 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 285/634] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:55 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:55.642499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:55.643138 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:55.649485 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:55.649923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:55.650666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:55.651122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:55.788891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:55.797400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-12bc79c6-baa3-44e9-a42f-4e5a894f3251 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.158724 May 23 18:11:55.797956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 286/635] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:55 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:56.098492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:56.099071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:56.105248 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:56.105693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:56.106449 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:56.106914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:56.238293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:56.245592 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4240f010-d5a5-4c66-87d3-0d6c8d078ed1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.151007 May 23 18:11:56.246866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 287/636] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:56 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:56.251380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:56.251974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:56.257991 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:56.258442 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:56.259247 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:56.259681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:56.392761 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:56.401262 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:56.402778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:56.404034 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b6e5f7bb-ab16-403a-8840-d90fed861a3b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.156183 May 23 18:11:56.404583 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 288/637] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:56 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:56.813852 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:56.814483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:56.820886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:56.821324 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:56.822067 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:56.822495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:56.951094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:56.958413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7872d6a5-fead-467e-b5f1-fdec7101f5a2 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.148462 May 23 18:11:56.959004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 289/638] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:56 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:57.263664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:57.264278 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:57.270367 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:57.270859 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:57.271625 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:57.272122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:57.403418 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:57.411785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-81ad9e8b-a1a6-4e21-9a7c-0c66660f77b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.152613 May 23 18:11:57.412356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 290/639] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:57 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:57.424084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:57.424737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:57.431249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:57.431841 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:57.432740 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:57.433280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:57.570596 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:57.579562 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:57.581193 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:57.582339 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8d718ef-c081-4d9a-8971-3434ba64c319 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.163287 May 23 18:11:57.582927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 291/640] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:57 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:57.974890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:57.975753 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:57.985732 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:57.987059 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:57.988603 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:57.989129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:58.158194 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:58.166266 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-47d470d1-480e-4558-9045-b9a21c951dc0 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.195035 May 23 18:11:58.167144 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 292/641] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:57 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:11:58.431851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:58.432473 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:58.439700 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:58.440150 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:58.440939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:58.441381 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:58.609741 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:58.617119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-184d5f3d-d7aa-451a-a63b-5c887b8bd112 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.189344 May 23 18:11:58.617680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 293/642] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:58 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:58.622145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:58.622795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:58.628603 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:58.629054 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:58.629846 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:58.630289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:58.757599 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:58.765806 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:58.767391 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:58.768611 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51a28973-55b2-4820-9651-f066ee9a41c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.149968 May 23 18:11:58.769170 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 294/643] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:58 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:11:59.184867 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:59.185489 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:59.191969 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:59.192421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:59.193176 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:59.193610 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:59.197437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:59.328943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:59.336300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04acc595-babb-48f4-8b91-e610dcc02fcc tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.155784 May 23 18:11:59.336862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 295/644] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:59 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:59.634073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:59.634686 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:59.641370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:59.641820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:59.642579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:59.643043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:59.771413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:59.779161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e0bca68d-374b-409f-854c-82d006774c96 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.149081 May 23 18:11:59.779660 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 296/645] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:11:59 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:11:59.786895 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:11:59.787505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:11:59.793893 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:59.794339 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:59.795133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:11:59.795575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:11:59.921968 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:59.929816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:59.931351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:11:59.932498 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df72b079-c713-420c-9fdb-4d0a7bbb3d5a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.149263 May 23 18:11:59.933053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 297/646] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:11:59 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:12:00.352747 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:00.353372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:00.360565 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:00.361108 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:00.361911 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:00.362377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:00.495023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:00.503301 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-202d963d-cb23-4969-8bb6-c4db42823b41 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.154756 May 23 18:12:00.503870 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 298/647] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:00 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:00.796926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:00.797534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:00.803675 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:00.804116 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:00.804868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:00.805305 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:00.932548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:00.940298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c7929d8f-8d75-43c6-8644-863f7d2858c7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.148396 May 23 18:12:00.940855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 299/648] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:00 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:00.951413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:00.952014 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:00.957761 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:00.958206 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:00.958995 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:00.959433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:01.092487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:01.100400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:01.101894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:01.103069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2d347288-f982-4781-b231-16ef29a81889 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.155168 May 23 18:12:01.103638 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 300/649] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:00 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:12:01.108106 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:01.108597 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:01.114273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:01.114741 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:01.115499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:01.115931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:01.244137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lazy-loading 'services' on Instance uuid 8f54f9aa-b925-4447-9087-41973631332d {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:12:01.296848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-82cd3b58-b86b-42a8-a53f-edcfed775788 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.180687 May 23 18:12:01.297762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 350/650] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:11:52 2022] POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments => generated 194 bytes in 9182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:12:01.365314 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b2c171e-3cd7-49e7-973b-58c146b255fe tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d/os-volume_attachments/e1fbcc35-bfb8-454d-8c78-26b2bca3b58a" status: 202 len: 0 microversion: 2.1 time: 0.260493 May 23 18:12:01.365993 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 301/651] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:12:01 2022] DELETE /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d/os-volume_attachments/e1fbcc35-bfb8-454d-8c78-26b2bca3b58a => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:12:01.520611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:01.521368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:01.528782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:01.529274 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:01.530102 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:01.530584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:01.656460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:01.663803 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-23b39d59-cf1e-4d10-baa6-037da0792d63 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.147907 May 23 18:12:01.664366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 351/652] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:01 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:01.957579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:01.958265 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:01.965903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:01.966351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:01.967133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:01.967567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:02.112947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:02.120820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d49f2b7a-3281-4c50-86e6-9c18cf6df58f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.167270 May 23 18:12:02.121539 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 302/653] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:01 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:02.121705 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:02.122417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:02.124839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:02.131264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:02.131709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:02.132464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:02.132894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:02.264492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:02.272313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:02.273806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:02.274984 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-55654506-3559-4663-b9d9-98daf3b21b58 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.157595 May 23 18:12:02.275535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 352/654] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:02 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:12:02.681169 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:02.681701 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:02.688779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:02.689231 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:02.689998 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:02.690439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:02.821044 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:02.828437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-db03ec05-d8a8-482f-8b9f-5007d60b7714 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.151200 May 23 18:12:02.828983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 303/655] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:02 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:03.137381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:03.138080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:03.144621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:03.145065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:03.145822 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:03.146252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:03.278204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:03.285523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ed62400f-cf40-45eb-ab73-28cb08eb69ed tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.152173 May 23 18:12:03.286082 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 353/656] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:03 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:03.293440 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:03.294051 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:03.300127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:03.300576 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:03.301336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:03.301774 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:03.498539 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:03.515362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:03.518043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:03.524258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ff235c55-b16c-4928-b48a-6187a75c3119 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.235047 May 23 18:12:03.535063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 304/657] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:03 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:03.845130 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:03.845728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:03.851700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:03.852136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:03.852879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:03.853307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:03.996446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:04.004958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2cce520-487e-4b25-be17-77f8f6275b89 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.163568 May 23 18:12:04.005903 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 354/658] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:03 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:04.302486 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:04.303135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:04.310140 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:04.310601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:04.311626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:04.312171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:04.451781 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:04.459088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8922794-9aad-413b-ac5d-0e7df1d7dfd9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.160373 May 23 18:12:04.459646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 305/659] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:04 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:04.544111 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:04.544721 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:04.551221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:04.551662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:04.552443 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:04.552871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:04.682829 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:04.691173 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:04.692715 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:04.693867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f35a43b2-3885-44d4-89f1-8e6fd6d041ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.154327 May 23 18:12:04.694426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 355/660] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:04 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:04.935759 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a1d5b92f-34cf-4b25-8bec-0d24a3587b76 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:04.941825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1d5b92f-34cf-4b25-8bec-0d24a3587b76 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:04.942280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1d5b92f-34cf-4b25-8bec-0d24a3587b76 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.010276 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a1d5b92f-34cf-4b25-8bec-0d24a3587b76 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Going to try to stop instance {{(pid=117928) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 18:12:05.022689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:05.023395 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:05.031515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.032049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.032887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.033379 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.064061 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a1d5b92f-34cf-4b25-8bec-0d24a3587b76 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action" status: 202 len: 0 microversion: 2.1 time: 0.132062 May 23 18:12:05.068223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 306/661] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:12:04 2022] POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:12:05.073212 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:05.074573 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:05.077734 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:05.082203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.082655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.083476 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.083951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.205640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:05.213919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e57336be-28a0-4109-9b02-d9805994198a tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.194979 May 23 18:12:05.215150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 356/662] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:05 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:05.239327 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:05.247880 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7207c321-03ff-40f3-b6ee-100e47ec955b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.178654 May 23 18:12:05.248463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 307/663] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:05 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:05.289057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-cc8f72bd-f7fc-4eff-85dc-ea19681e235c req-3acf7a20-a8bc-4ac8-8b4f-0529f4f1507c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1561ef77-19e9-45a6-b5cc-85485e461f25", "name": "network-vif-plugged", "status": "completed", "tag": "6a95cca7-7db8-4776-96ff-62d047ad30ac"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:05.298292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-cc8f72bd-f7fc-4eff-85dc-ea19681e235c req-3acf7a20-a8bc-4ac8-8b4f-0529f4f1507c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.298787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-cc8f72bd-f7fc-4eff-85dc-ea19681e235c req-3acf7a20-a8bc-4ac8-8b4f-0529f4f1507c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.311073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-cc8f72bd-f7fc-4eff-85dc-ea19681e235c req-3acf7a20-a8bc-4ac8-8b4f-0529f4f1507c service nova] Creating event network-vif-plugged:6a95cca7-7db8-4776-96ff-62d047ad30ac for instance 1561ef77-19e9-45a6-b5cc-85485e461f25 on hv-cinder-75078 May 23 18:12:05.315954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-cc8f72bd-f7fc-4eff-85dc-ea19681e235c req-3acf7a20-a8bc-4ac8-8b4f-0529f4f1507c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030756 May 23 18:12:05.316663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 357/664] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:05.476049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:05.476705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:05.484259 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.484701 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.485463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.485893 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.643433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:05.652112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d14cb994-0857-4b5b-b5be-db2a9fa48b84 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.179667 May 23 18:12:05.652604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 308/665] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:05 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:05.712606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:05.713296 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:05.719444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.719889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.720693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:05.721124 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:05.858212 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:05.866265 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:05.867773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:05.868946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-51773330-24a8-40da-aa0d-2c03da9a2161 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.161083 May 23 18:12:05.869497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 358/666] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:05 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:06.232080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:06.232691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:06.238774 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.239223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:06.239976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.240412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:06.265960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:06.266576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:06.272655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.273131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:06.273894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.274331 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:06.376112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:06.384622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8e406bd-c0bc-4d9c-a0e4-ab87ff982ce7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.156181 May 23 18:12:06.385158 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 309/667] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:06 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:06.405379 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:06.413515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ef4f9505-043d-432d-8340-7b4201d448d7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.152082 May 23 18:12:06.414066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 359/668] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:06 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:06.668510 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:06.669217 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:06.675593 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.676113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:06.676935 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.677460 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:06.681273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:06.812656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:06.820846 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe828f5d-cb39-4555-8dae-40c958a8ac6c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.156632 May 23 18:12:06.821412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 310/669] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:06 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:06.887416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:06.888019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:06.894549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.895022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:06.895769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:06.896200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:07.024881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:07.033406 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:07.034945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:07.036089 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-17bf9252-5d4f-4687-b797-96402a5cfc57 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.153020 May 23 18:12:07.036672 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 360/670] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:06 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:07.402368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:07.403012 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:07.409086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:07.409535 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:07.410293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:07.410758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:07.431377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:07.431987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:07.438050 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:07.438495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:07.439290 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:07.439726 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:07.546367 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:07.553802 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-28cc63e4-6f79-4d9e-a9aa-7b095aaf2ed8 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1314 microversion: 2.1 time: 0.155873 May 23 18:12:07.554647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 311/671] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:07 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:07.569419 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:07.577960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e144ba9-bc15-4508-94a3-0d49f9093ca6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.150440 May 23 18:12:07.578520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 361/672] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:07 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:07.837282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:07.837890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:07.844434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:07.844881 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:07.845635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:07.846074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:07.976093 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:07.984839 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eeacbde7-f424-45c0-805c-2fe59b62c0f5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.151138 May 23 18:12:07.985600 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 312/673] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:07 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:08.054501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:08.055178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:08.062607 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:08.063081 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:08.063838 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:08.064265 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:08.096508 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-2905de1b-70e7-439c-af22-3f892849dac8 req-2b045466-4c1a-44a8-b5c7-61d943549d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38d8037-09eb-4c41-b6d8-7a2126321b0b", "name": "network-vif-plugged", "status": "completed", "tag": "cfcde4fb-a3d1-4e66-a4ca-3d5933501427"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:08.107785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-2905de1b-70e7-439c-af22-3f892849dac8 req-2b045466-4c1a-44a8-b5c7-61d943549d00 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:08.108387 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-2905de1b-70e7-439c-af22-3f892849dac8 req-2b045466-4c1a-44a8-b5c7-61d943549d00 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:08.122819 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-2905de1b-70e7-439c-af22-3f892849dac8 req-2b045466-4c1a-44a8-b5c7-61d943549d00 service nova] Creating event network-vif-plugged:cfcde4fb-a3d1-4e66-a4ca-3d5933501427 for instance d38d8037-09eb-4c41-b6d8-7a2126321b0b on hv-cinder-75078 May 23 18:12:08.130322 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-2905de1b-70e7-439c-af22-3f892849dac8 req-2b045466-4c1a-44a8-b5c7-61d943549d00 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036633 May 23 18:12:08.132785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 313/674] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:12:08.214048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:08.223124 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:08.224627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:08.225772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0ae09988-efa7-44f0-bc6a-0dbd918a4122 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.175219 May 23 18:12:08.226327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 362/675] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:08 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:08.571920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:08.572622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:08.579743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:08.580195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:08.580962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:08.581401 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:08.594165 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:08.594993 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:08.601429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:08.601997 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:08.602994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:08.603531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:08.728375 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:08.738074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-498cd046-c1ee-46e4-add6-babda3e681b3 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1498 microversion: 2.1 time: 0.170615 May 23 18:12:08.739552 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 314/676] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:08 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:08.749502 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:08.760579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c1652db3-d4be-4c9f-833a-eabef2f301a6 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.170260 May 23 18:12:08.768545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 363/677] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:08 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:09.002615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:09.003259 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:09.014491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.014982 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.015763 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.016215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.151694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:09.160592 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7d524a6d-edc6-4e35-aeab-4ee694845efa tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.162511 May 23 18:12:09.161349 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 315/678] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:08 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:09.243878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:09.244491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:09.251563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.252014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.252335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:09.252775 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.252893 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:09.253211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.259088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.259520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.260279 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.260713 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.285919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:12:09.371508 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ea775501-1a3c-4516-8d83-ffaa025192c6 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 204 len: 0 microversion: 2.1 time: 0.121821 May 23 18:12:09.373830 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 316/679] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:12:09 2022] DELETE /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 18:12:09.381810 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:09.382547 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:09.391389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.391847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.392621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.393058 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.401678 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:09.409568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:09.411120 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:09.412263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-03429b8c-9374-48c7-af5c-26f9e72dff77 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.172303 May 23 18:12:09.413052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 364/680] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:09 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:09.525120 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:09.533134 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c90093d7-d3b5-416c-801a-077a209addf7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1504 microversion: 2.1 time: 0.156054 May 23 18:12:09.533698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 317/681] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:09 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:09.787749 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:09.788353 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:09.795101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.795540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.796289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:09.796713 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:09.927727 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:09.935711 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d8dcf07a-660c-4c7e-8c00-42f876801fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.151764 May 23 18:12:09.936270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 365/682] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:09 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:10.177421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:10.178019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:10.185123 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.185641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:10.186415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.186886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:10.317998 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:10.326554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c05160e0-b99b-4b07-8896-901999b976ad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.152997 May 23 18:12:10.330842 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 318/683] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:10 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:10.431139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:10.431742 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:10.438200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.438715 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:10.439484 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.439914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:10.443999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:10.550688 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:10.551410 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:10.557254 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.557767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:10.559492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.559923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:10.569532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:10.578637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:10.580144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:10.581282 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-41ad4f40-4908-487f-8cff-0edea2e23e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.154108 May 23 18:12:10.581835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 366/684] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:10 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:10.687909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:10.696316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3dd99b30-d603-49e7-8f5b-018765a0c580 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1504 microversion: 2.1 time: 0.149445 May 23 18:12:10.696876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 319/685] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:10 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:10.953484 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:10.954113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:10.959989 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.960429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:10.961179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:10.961604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:11.093656 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:11.101623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bd3fefb6-924e-42e5-b8b1-f181ffb67455 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.151944 May 23 18:12:11.102183 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 367/686] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:10 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:11.343874 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:11.344409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:11.351206 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:11.351658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:11.352421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:11.352861 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:11.486239 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:11.493654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7459e45a-970c-4060-a40e-1713c54b200c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.154458 May 23 18:12:11.494221 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 320/687] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:11 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:11.599755 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:11.600293 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:11.607484 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:11.607930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:11.608679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:11.609112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:11.713345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:11.714647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:11.720691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:11.721137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:11.721903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:11.722344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:11.736915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:11.744820 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:11.746431 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:11.747711 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-945f7a22-7b68-462e-8ba0-b6962cfb3ce3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.151923 May 23 18:12:11.748269 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 368/688] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:11 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:11.850283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:11.857645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-26771c89-81ce-4097-842b-02080552f91e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1504 microversion: 2.1 time: 0.148168 May 23 18:12:11.858203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 321/689] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:11 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:12.119298 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:12.119915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:12.126590 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.127077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.127836 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.128271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.143354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-b20631ee-9df3-4044-9160-b0efc668f5e7 req-cf515216-41c5-4b11-b07f-80299ad0d5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebec7dc8-9547-4dac-9035-078304c6793c", "name": "network-vif-plugged", "status": "completed", "tag": "8a5c394c-2439-4849-a7b4-278598a8a204"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:12.153808 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b20631ee-9df3-4044-9160-b0efc668f5e7 req-cf515216-41c5-4b11-b07f-80299ad0d5a4 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.154260 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b20631ee-9df3-4044-9160-b0efc668f5e7 req-cf515216-41c5-4b11-b07f-80299ad0d5a4 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.165837 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-b20631ee-9df3-4044-9160-b0efc668f5e7 req-cf515216-41c5-4b11-b07f-80299ad0d5a4 service nova] Creating event network-vif-plugged:8a5c394c-2439-4849-a7b4-278598a8a204 for instance ebec7dc8-9547-4dac-9035-078304c6793c on hv-cinder-75078 May 23 18:12:12.171485 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-b20631ee-9df3-4044-9160-b0efc668f5e7 req-cf515216-41c5-4b11-b07f-80299ad0d5a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032370 May 23 18:12:12.172247 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 322/690] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:12:12.264775 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:12.272632 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4604b6bf-0067-4638-bf63-cbfa277fd401 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.157247 May 23 18:12:12.273186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 369/691] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:12 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:12.512037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:12.512845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:12.519800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.520246 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.521069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.521506 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.657408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:12.664827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0169e35b-b74f-4121-a6b8-0b2fa4755daf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1267 microversion: 2.1 time: 0.158205 May 23 18:12:12.665389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 323/692] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:12 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:12.765902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:12.766477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:12.772965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.773401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.774149 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.774576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.875962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:12.876573 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:12.882766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.883204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.883961 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:12.884386 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:12.906852 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:12.914891 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:12.916570 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:12.918050 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2c8f6668-ae95-458f-9414-4d54d14cbef2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.156641 May 23 18:12:12.918763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 370/693] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:12 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:13.018811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:13.026159 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08d99894-feda-4833-8021-cb2e0c93d8fa tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1504 microversion: 2.1 time: 0.154248 May 23 18:12:13.027084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 324/694] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:12 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:13.290041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:13.290567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:13.297458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.297892 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.298633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.299084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.428810 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:13.437673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-66cb6b0b-904c-4ded-aca7-e9346635a40f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.151747 May 23 18:12:13.438222 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 371/695] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:13 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:13.681868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:13.682634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:13.689468 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.689924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.690714 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.691268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.898145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:13.906873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8583433-6043-4214-b331-4ee03e467c2f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1454 microversion: 2.1 time: 0.229199 May 23 18:12:13.907462 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 325/696] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:13 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1454 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:13.923483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:13.924390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:13.931031 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.931492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.932264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.932968 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.936793 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:13.939497 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:13.945800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.946419 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.947031 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:13.947913 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:13.971453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:14.143588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:14.151263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-44ce460a-b97c-49bc-9977-8806671e4e86 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1454 microversion: 2.1 time: 0.231725 May 23 18:12:14.152416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 372/697] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:13 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1454 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:14.162853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:14.162853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:14.163097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:14.163496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:14.164455 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:14.165055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:14.262283 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:14.272904 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd55576e-d569-4128-a8f7-33e05c71ca5e tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1462 microversion: 2.1 time: 0.119462 May 23 18:12:14.273053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:14.273631 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 373/698] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:14 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1462 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:14.291681 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-11c06d9d-cc53-4349-8508-841151e4fcd2 req-2620a324-b237-43e1-8c98-607907a5abe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1561ef77-19e9-45a6-b5cc-85485e461f25", "name": "network-vif-deleted", "tag": "6a95cca7-7db8-4776-96ff-62d047ad30ac"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:14.297360 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:14.298909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:14.300079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04ccde92-9fe7-44d6-9873-675a52d40089 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.367740 May 23 18:12:14.300818 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 326/699] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:13 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:14.300959 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-11c06d9d-cc53-4349-8508-841151e4fcd2 req-2620a324-b237-43e1-8c98-607907a5abe3 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:14.301247 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-11c06d9d-cc53-4349-8508-841151e4fcd2 req-2620a324-b237-43e1-8c98-607907a5abe3 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:14.313773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-11c06d9d-cc53-4349-8508-841151e4fcd2 req-2620a324-b237-43e1-8c98-607907a5abe3 service nova] Creating event network-vif-deleted:6a95cca7-7db8-4776-96ff-62d047ad30ac for instance 1561ef77-19e9-45a6-b5cc-85485e461f25 on hv-cinder-75078 May 23 18:12:14.319541 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-11c06d9d-cc53-4349-8508-841151e4fcd2 req-2620a324-b237-43e1-8c98-607907a5abe3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038681 May 23 18:12:14.320326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 374/700] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:14.455417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:14.456033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:14.462044 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:14.462490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:14.463300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:14.463735 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:14.594899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:14.603522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e3434efa-617c-4666-a508-13587e4fed95 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.151931 May 23 18:12:14.604102 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 327/701] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:14 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:15.233186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:15.233943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:15.240527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.240973 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.241733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.242165 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.290669 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:15.291399 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:15.298059 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.298567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.299405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.299834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.332162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.332690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.333121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lazy-loading 'fault' on Instance uuid 1561ef77-19e9-45a6-b5cc-85485e461f25 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:12:15.375084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca87844c7ef4b2da0a12915aeff81a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743c4e622a84f7e9a2bf858b3a164fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:15.382909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51554eea-55f5-4c35-8f27-80f7f9c2e6e9 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 200 len: 1304 microversion: 2.1 time: 0.096061 May 23 18:12:15.383468 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 328/702] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:15 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:15.389269 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:15.390608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:15.397663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.398382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.398930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.399367 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.452584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:15.460729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b68efa76-a052-4d6c-92f7-b32d6acc535b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1595 microversion: 2.1 time: 0.231911 May 23 18:12:15.461291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 375/703] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:15 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1595 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:15.563593 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:15.572834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:15.574517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:15.575705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eff9e1a6-f11d-4429-a526-31a97ec935f8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.191169 May 23 18:12:15.576261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 329/704] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:15 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:15.621750 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:15.622530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:15.629159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.629692 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.630808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:15.631309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:15.882108 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:15.892785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-954f0a7e-675b-45be-a5a7-53e0a3d4a8ed tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.275454 May 23 18:12:15.893502 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 376/705] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:15 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:16.376249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-a0f11af3-2633-4777-a199-c20b988abbde req-7a456b94-4f3a-4c62-be38-9e56226e68f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38d8037-09eb-4c41-b6d8-7a2126321b0b", "tag": "cfcde4fb-a3d1-4e66-a4ca-3d5933501427"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:16.387667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-a0f11af3-2633-4777-a199-c20b988abbde req-7a456b94-4f3a-4c62-be38-9e56226e68f0 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:16.388528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-a0f11af3-2633-4777-a199-c20b988abbde req-7a456b94-4f3a-4c62-be38-9e56226e68f0 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:16.402682 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:16.403996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] [instance: 1561ef77-19e9-45a6-b5cc-85485e461f25] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:16.404715 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-a0f11af3-2633-4777-a199-c20b988abbde req-7a456b94-4f3a-4c62-be38-9e56226e68f0 service nova] Creating event network-changed:cfcde4fb-a3d1-4e66-a4ca-3d5933501427 for instance d38d8037-09eb-4c41-b6d8-7a2126321b0b on hv-cinder-75078 May 23 18:12:16.410864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-a0f11af3-2633-4777-a199-c20b988abbde req-7a456b94-4f3a-4c62-be38-9e56226e68f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038434 May 23 18:12:16.412614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 330/706] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:16.415742 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:16.416231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:16.417898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:16.418808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:16.439059 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] HTTP exception thrown: Instance 1561ef77-19e9-45a6-b5cc-85485e461f25 could not be found. May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Request method failure captured: May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 HTTP/1.1 May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii84iou9_XBe1r4S2HVJ_t19e7qXs-eFmqgx4UB3vvFZKxEZBpld73hSmA5vGEzxThlSRII-Emewo2YeG7lehHx5LUlpZXyU9gpy3HNA_xx8wKkgqGzVvIHH_dHu2vutPIvOBi5jwcFOd0GPDmO_JNhnEFFXHd9Qna3WPaAxHjjC3fyM May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: c743c4e622a84f7e9a2bf858b3a164fe May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesActionsTest-1949718339 May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:12:16.441401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c743c4e622a84f7e9a2bf858b3a164fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesActionsTest-1949718339 May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: c743c4e622a84f7e9a2bf858b3a164fe May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesActionsTest-1949718339 May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesActionsTest-1949718339-project May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 7ca87844c7ef4b2da0a12915aeff81a0 May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesActionsTest-1949718339-project May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 1561ef77-19e9-45a6-b5cc-85485e461f25 could not be found. May 23 18:12:16.443056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '1561ef77-19e9-45a6-b5cc-85485e461f25'} May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1561ef77-19e9-45a6-b5cc-85485e461f25 could not be found. May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:12:16.443912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1561ef77-19e9-45a6-b5cc-85485e461f25 could not be found. May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1561ef77-19e9-45a6-b5cc-85485e461f25 could not be found. May 23 18:12:16.445363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:16.447590 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] Returning 404 to user: Instance 1561ef77-19e9-45a6-b5cc-85485e461f25 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:12:16.448734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4c06aba5-b2cd-4809-a2e7-0e535e75c1a7 tempest-VolumesActionsTest-1949718339 tempest-VolumesActionsTest-1949718339-project] 10.222.0.30 "GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25" status: 404 len: 111 microversion: 2.1 time: 0.051718 May 23 18:12:16.450083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 377/707] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:16 2022] GET /compute/v2.1/servers/1561ef77-19e9-45a6-b5cc-85485e461f25 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 18:12:16.599824 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:16.601579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:16.613190 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:16.614623 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:16.615939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:16.616629 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:16.910693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:16.911883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:16.919630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:16.927776 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:16.928241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:16.929062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:16.929530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:16.939268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:16.947974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:16.951111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-01eec1c3-7728-430a-9684-b74d68e7071e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1745 microversion: 2.20 time: 0.357364 May 23 18:12:16.953230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 331/708] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:16 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1745 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:17.104921 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:17.114623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-98adc80e-f98a-400a-bcfb-f8e897f1b9ce tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.208477 May 23 18:12:17.115695 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 378/709] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:16 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:17.355983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:17.356472 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:17.363354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:17.363834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:17.364618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:17.365056 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:17.408954 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:12:17.538215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-244335f8-59f2-44e1-bc76-4dfe60c4599a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 204 len: 0 microversion: 2.1 time: 0.187406 May 23 18:12:17.540042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 332/710] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:12:17 2022] DELETE /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:12:17.556054 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:17.557169 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:17.572693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:17.574046 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:17.575744 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:17.576676 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:17.762423 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:17.773565 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30b9fc3f-19d5-4239-8c9f-20b23e3e84ef tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1513 microversion: 2.1 time: 0.224610 May 23 18:12:17.774168 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 379/711] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:17 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:17.972245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:17.973395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:17.981099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:17.981855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:17.982909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:17.983592 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:18.134914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:18.135992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:18.142654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:18.143564 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:18.144553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:18.145242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:18.179016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:18.210151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:18.213363 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:18.221664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-47d6703b-ea16-483d-b0e9-6498851c3d74 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.253510 May 23 18:12:18.228028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 333/712] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:17 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:18.340532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-83973c13-4a97-4039-9bcb-53867abf0950 req-d79195c7-4b2f-4352-a952-263bb019f8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c5bdee-1834-416c-a8e0-64858b483964", "tag": "c97baa91-db27-4da5-963a-92d5ba833cb0"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:18.361963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-83973c13-4a97-4039-9bcb-53867abf0950 req-d79195c7-4b2f-4352-a952-263bb019f8e1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:18.363421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-83973c13-4a97-4039-9bcb-53867abf0950 req-d79195c7-4b2f-4352-a952-263bb019f8e1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:18.386409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-83973c13-4a97-4039-9bcb-53867abf0950 req-d79195c7-4b2f-4352-a952-263bb019f8e1 service nova] Creating event network-changed:c97baa91-db27-4da5-963a-92d5ba833cb0 for instance 62c5bdee-1834-416c-a8e0-64858b483964 on hv-cinder-75078 May 23 18:12:18.398199 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:18.399232 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-83973c13-4a97-4039-9bcb-53867abf0950 req-d79195c7-4b2f-4352-a952-263bb019f8e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063601 May 23 18:12:18.404377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 334/713] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:18.454088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4e0b9d17-da5a-4006-8cce-4e745961113a tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.324448 May 23 18:12:18.455391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 380/714] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:18 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:18.792901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:18.794326 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:18.812110 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:18.812771 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:18.813724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:18.814317 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:19.073242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:19.082146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3cab7b02-ba6f-48fe-8c84-a503081979a6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1513 microversion: 2.1 time: 0.295127 May 23 18:12:19.085120 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 335/715] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:18 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1513 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:19.246241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:19.247344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:19.260404 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:19.261426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:19.262434 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:19.263868 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:19.475404 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:19.477280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:19.492556 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:19.493453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:19.499501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:19.500619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:19.574936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:19.591121 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:19.593462 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:19.595292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-479a6fdd-27d9-45fd-a948-60ed578f3814 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.353506 May 23 18:12:19.597218 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 381/716] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:19 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:19.738540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:19.749795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a47826c9-945d-429a-b407-56a62d816b24 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.281759 May 23 18:12:19.750374 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 336/717] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:19 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:19.856888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1467906619"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:19.857551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:19.865498 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:19.866092 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:19.866972 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:19.867528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.052149 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.network.security_group_api [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Adding security group a050e2ce-c4b5-464c-8563-a088791fa62b to port c97baa91-db27-4da5-963a-92d5ba833cb0 May 23 18:12:20.124293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:20.125923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:20.142944 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.143800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.145925 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.146609 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.363154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:20.374032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ce6a2d5-3a02-4a0c-8a15-248c7e769f7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1513 microversion: 2.1 time: 0.273558 May 23 18:12:20.375558 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 337/718] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:20 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:20.605693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ac8308b0-53f7-4d77-b731-eb0a4e94825f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/action" status: 202 len: 0 microversion: 2.1 time: 0.754125 May 23 18:12:20.607716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 382/719] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:12:19 2022] POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:12:20.616965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:20.621794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:20.622825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:20.629094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:20.642736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.645810 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.647212 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.647653 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.650638 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.651141 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.652475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.653059 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.868558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:20.878902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:20.880737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:20.889111 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-90d0c931-9f80-4bd0-b967-5c9626709b97 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.265969 May 23 18:12:20.889371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 383/720] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:20 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:20.901737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-bb812e20-e1aa-41d9-9de2-6b2440455242 req-4f354453-fe4e-47a5-a663-44cfb36d6d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c5bdee-1834-416c-a8e0-64858b483964", "tag": "c97baa91-db27-4da5-963a-92d5ba833cb0"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:20.920369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-bb812e20-e1aa-41d9-9de2-6b2440455242 req-4f354453-fe4e-47a5-a663-44cfb36d6d83 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.920808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-bb812e20-e1aa-41d9-9de2-6b2440455242 req-4f354453-fe4e-47a5-a663-44cfb36d6d83 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.943144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-bb812e20-e1aa-41d9-9de2-6b2440455242 req-4f354453-fe4e-47a5-a663-44cfb36d6d83 service nova] Creating event network-changed:c97baa91-db27-4da5-963a-92d5ba833cb0 for instance 62c5bdee-1834-416c-a8e0-64858b483964 on hv-cinder-75078 May 23 18:12:20.950448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-bb812e20-e1aa-41d9-9de2-6b2440455242 req-4f354453-fe4e-47a5-a663-44cfb36d6d83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059195 May 23 18:12:20.951369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 384/721] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:20.956741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:20.960348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:20.964664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:20.971165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7123cd19-e8c0-4180-82fa-f432702394a4 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1642 microversion: 2.1 time: 0.359677 May 23 18:12:20.973230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 338/722] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:20 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1642 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:20.977068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.977507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.978270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:20.978710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:20.986748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:21.162263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:21.195190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30090a65-02d3-4d2d-b6f6-a1b2e4e7e73e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1720 microversion: 2.1 time: 0.242532 May 23 18:12:21.195794 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 385/723] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:20 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:21.393435 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:21.394847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:21.405974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:21.406722 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:21.407526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:21.407959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:21.564622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:21.576316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-78f4eead-b5b3-4315-b7fe-ee41d632cff3 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1513 microversion: 2.1 time: 0.187012 May 23 18:12:21.576891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 339/724] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:21 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:21.907473 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:21.908908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:21.915936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:21.916470 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:21.917999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:21.918496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.113939 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:22.159605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:22.176401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:22.180984 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-066d8278-23b9-4d3e-b6e4-bbe680b9783f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.277358 May 23 18:12:22.194754 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 386/725] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:21 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:22.214721 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:22.215678 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:22.223496 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:22.224073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.224983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:22.225666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.399704 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:22.414906 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ff8aedc4-cec5-4d7b-ac38-dd31354383ef tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1697 microversion: 2.1 time: 0.205204 May 23 18:12:22.436458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d718deea-c651-4715-bb00-2686e2ec3305 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:22.447167 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 340/726] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:22 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1697 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:22.449582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d718deea-c651-4715-bb00-2686e2ec3305 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:22.452911 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d718deea-c651-4715-bb00-2686e2ec3305 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.577425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d718deea-c651-4715-bb00-2686e2ec3305 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Going to try to start instance {{(pid=117929) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 18:12:22.595343 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:22.596547 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:22.606971 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:22.607655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.608597 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:22.609187 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.675798 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d718deea-c651-4715-bb00-2686e2ec3305 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action" status: 202 len: 0 microversion: 2.1 time: 0.244616 May 23 18:12:22.676863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 387/727] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:12:22 2022] POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:12:22.686096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:22.688576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:22.719938 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:22.722202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.723260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:22.725887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:22.978119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:22.978805 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:22.987686 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a730f467-f4d8-4c59-ac1f-39ca5a3196aa tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1513 microversion: 2.1 time: 0.396641 May 23 18:12:22.988485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04d254b2-c97f-4250-acd9-accc912bbf9d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1706 microversion: 2.1 time: 0.307085 May 23 18:12:22.988614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 341/728] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:22 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1513 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:22.999026 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 388/729] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:22 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1706 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:12:23.204936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:23.205541 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:23.212141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:23.212589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:23.213349 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:23.215812 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:23.246818 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:23.393257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:23.403161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:23.415897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:23.418229 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-48efd3cf-3f48-4577-98ab-40ecb610dbaa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.217388 May 23 18:12:23.419291 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 342/730] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:23 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:24.012208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:24.013893 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:24.014946 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:24.016694 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:24.032171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:24.035774 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:24.036051 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:24.036853 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:24.037075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:24.038123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:24.039906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:24.040948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:24.260489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:24.274511 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b0f5c75b-8a6f-47b3-a059-f92c7ea2defe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1706 microversion: 2.1 time: 0.272699 May 23 18:12:24.286781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 389/731] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:24 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1706 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:24.450373 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:24.452155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:24.460718 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:24.461554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:24.462518 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:24.463153 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:24.917278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:24.929429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:24.944549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:24.948443 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-368819d1-3c8e-4f50-b45a-8fa553a7a046 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.504271 May 23 18:12:24.967571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 390/732] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:24 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:24.979099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-49ea7a53-7940-4c39-ad99-fa746a904bba req-53d8c610-5c62-4365-aed7-537cd3c2df6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f54f9aa-b925-4447-9087-41973631332d", "name": "network-vif-deleted", "tag": "d8ae9041-7cdd-40d4-8352-23e8c761da28"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:25.007428 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-49ea7a53-7940-4c39-ad99-fa746a904bba req-53d8c610-5c62-4365-aed7-537cd3c2df6d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:25.008568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-49ea7a53-7940-4c39-ad99-fa746a904bba req-53d8c610-5c62-4365-aed7-537cd3c2df6d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:25.048263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-49ea7a53-7940-4c39-ad99-fa746a904bba req-53d8c610-5c62-4365-aed7-537cd3c2df6d service nova] Creating event network-vif-deleted:d8ae9041-7cdd-40d4-8352-23e8c761da28 for instance 8f54f9aa-b925-4447-9087-41973631332d on hv-cinder-75078 May 23 18:12:25.072562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-49ea7a53-7940-4c39-ad99-fa746a904bba req-53d8c610-5c62-4365-aed7-537cd3c2df6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102068 May 23 18:12:25.074555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 391/733] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:25.294385 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:25.295808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:25.320916 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:25.321671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:25.322630 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:25.323757 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:25.385836 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:25.395413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a9f50b5b-f9b8-4bed-8dd5-868f7d699e7a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 200 len: 1513 microversion: 2.1 time: 1.392675 May 23 18:12:25.400305 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 343/734] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:24 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 1513 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:25.631513 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:25.645810 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6d32c651-ec58-4212-aaad-05da12f6682f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1706 microversion: 2.1 time: 0.356134 May 23 18:12:25.647013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 392/735] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:25 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1706 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:25.979316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:25.979955 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:25.988416 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:25.988873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:25.989653 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:25.990092 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:26.236488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:26.245930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:26.251638 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:26.255751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f121a6c7-3678-4938-ab12-db23684713b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.279854 May 23 18:12:26.257514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 344/736] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:25 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:26.420390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:26.421313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 8f54f9aa-b925-4447-9087-41973631332d] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:26.458354 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:26.458842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:26.459664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:26.460106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:26.480819 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] HTTP exception thrown: Instance 8f54f9aa-b925-4447-9087-41973631332d could not be found. May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Request method failure captured: May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d HTTP/1.1 May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii84ALDi0v-uNQUm1mX4_n-6POXtsi5XqLDE24umjRyp4BnFxIolMxkW_7t1zlcaRFsGc8EApczzhFDsmGAFJYHgQVztPme5BNW3pVbBe151chR7SgMxvvEdTG81E2JaQoCYkONp3CwqPWdmTdqGh0NXMwqsnJiga2aBYguGVMaOJKOg May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: eefd7a6998d24e0189ed1c54dc911737 May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1009617757 May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:12:26.482639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotTestJSON-1009617757 May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: eefd7a6998d24e0189ed1c54dc911737 May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1009617757 May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotTestJSON-1009617757-project May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 3bc1f574f2e84b47ad12c67641cc087c May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotTestJSON-1009617757-project May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 8f54f9aa-b925-4447-9087-41973631332d could not be found. May 23 18:12:26.484360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '8f54f9aa-b925-4447-9087-41973631332d'} May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f54f9aa-b925-4447-9087-41973631332d could not be found. May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:12:26.485261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f54f9aa-b925-4447-9087-41973631332d could not be found. May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f54f9aa-b925-4447-9087-41973631332d could not be found. May 23 18:12:26.486687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:12:26.488868 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Returning 404 to user: Instance 8f54f9aa-b925-4447-9087-41973631332d could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:12:26.489877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2143ecdd-8be2-473b-aa60-cf81b3af5d9d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d" status: 404 len: 111 microversion: 2.1 time: 0.073482 May 23 18:12:26.490916 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 393/737] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:26 2022] GET /compute/v2.1/servers/8f54f9aa-b925-4447-9087-41973631332d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:12:26.671458 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:26.676134 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:26.699563 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:26.700047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:26.700821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:26.701252 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:26.993118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:27.005432 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e5e1e3bf-18a8-461c-ba00-fd1c569279b0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1710 microversion: 2.1 time: 0.344564 May 23 18:12:27.018161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 345/738] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:26 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1710 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:27.277859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:27.278387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:27.289856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:27.290320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:27.291126 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:27.291611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:27.447394 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:27.459555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:27.462056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:27.463720 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-23665099-87df-4483-b60f-435bacf9b060 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.190008 May 23 18:12:27.464572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 394/739] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:27 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:28.485059 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:28.486562 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:28.499020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:28.499020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:28.501322 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:28.502667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:28.687046 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:28.696933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:28.700516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:28.702361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-633cc8a7-03ab-41a3-a35c-a793444a9d1e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.221392 May 23 18:12:28.704729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 346/740] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:28 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:29.725689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:29.726278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:29.734264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:29.734951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:29.735955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:29.736371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:29.914756 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:29.924750 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:29.926504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:29.927689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-35bed9ce-d047-4011-8ead-1883fc129eb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.206081 May 23 18:12:29.928707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 395/741] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:29 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:30.948693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:30.949290 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:30.956246 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:30.957032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:30.957879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:30.958328 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:31.115184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:31.125561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:31.127172 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:31.128851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b9277bad-2f6f-48d5-a19a-7c73cf7bfb91 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.184691 May 23 18:12:31.129920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 347/742] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:30 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:32.150665 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:32.155236 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:32.159806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=88 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:32.164644 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:32.165358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:32.167010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:32.167837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:32.314287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:32.323881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:32.325524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:32.326969 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7e0afc8-8ad6-467a-ba5d-8f8ac8662729 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1740 microversion: 2.20 time: 0.182397 May 23 18:12:32.337562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 396/743] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:32 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:33.352973 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:33.355452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:33.363757 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:33.364589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:33.365481 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:33.365919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:33.645411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:33.654041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:33.655887 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:33.657281 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3bdc6b53-c208-4128-8242-8b8b3d69be7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1722 microversion: 2.20 time: 0.308811 May 23 18:12:33.658340 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 348/744] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:33 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:34.678336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:34.679979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:34.689014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:34.689988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:34.691196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:34.692111 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:34.847684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:34.857174 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:34.859142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:34.860661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b59efdd1-c70b-4167-9ca9-29be5d810eba tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1722 microversion: 2.20 time: 0.187102 May 23 18:12:34.861449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 397/745] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:34 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:12:35.880664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:35.881414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:35.887645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:35.890057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:35.890519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:35.891243 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:35.892041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:36.062792 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:36.071795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:36.073366 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:36.074589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-48e96de0-3021-403c-aaff-dd0f8fb9f3b8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1722 microversion: 2.20 time: 0.198086 May 23 18:12:36.075200 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 349/746] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:35 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:37.057783 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-f00ff657-877d-4fb6-88c2-fc26e50103a1 req-85a1da88-d88e-492d-8ce0-872802c6b30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebec7dc8-9547-4dac-9035-078304c6793c", "name": "network-vif-unplugged", "status": "completed", "tag": "8a5c394c-2439-4849-a7b4-278598a8a204"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:37.068504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f00ff657-877d-4fb6-88c2-fc26e50103a1 req-85a1da88-d88e-492d-8ce0-872802c6b30f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:37.069156 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f00ff657-877d-4fb6-88c2-fc26e50103a1 req-85a1da88-d88e-492d-8ce0-872802c6b30f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:37.094129 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-f00ff657-877d-4fb6-88c2-fc26e50103a1 req-85a1da88-d88e-492d-8ce0-872802c6b30f service nova] Creating event network-vif-unplugged:8a5c394c-2439-4849-a7b4-278598a8a204 for instance ebec7dc8-9547-4dac-9035-078304c6793c on hv-cinder-75078 May 23 18:12:37.099813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-f00ff657-877d-4fb6-88c2-fc26e50103a1 req-85a1da88-d88e-492d-8ce0-872802c6b30f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045633 May 23 18:12:37.100854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:37.102205 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 398/747] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:12:37.104714 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:37.114278 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:37.115132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:37.120803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:37.121933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:37.323687 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:37.334010 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:37.336075 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:37.337585 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fbbcb3f6-9e91-4b40-9e0f-1067e8486fbf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1722 microversion: 2.20 time: 0.248103 May 23 18:12:37.339407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 350/748] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:37 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:38.357745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:38.359163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:38.366029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:38.366544 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:38.368022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:38.368531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:38.513604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:38.524172 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:38.526154 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:38.527576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e36f5cef-530d-44f0-9536-6cf6caaeded5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1722 microversion: 2.20 time: 0.174945 May 23 18:12:38.538018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 399/749] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:38 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:12:39.545741 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:39.546327 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:39.553373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:39.553823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:39.554645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:39.555116 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:39.695797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:39.704415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:39.705902 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:39.707113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c8f080cc-fb71-4f73-936d-ecaf9aa4d07d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1722 microversion: 2.20 time: 0.165406 May 23 18:12:39.707675 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 351/750] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:39 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:40.726110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:40.726743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:40.734213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:40.734660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:40.735456 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:40.735888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:40.870856 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1021852920", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "networks": [{"uuid": "1be86e9e-9354-4908-a261-72437ace367c"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:40.892545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:40.900757 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:40.902284 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:40.903451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5f4984f5-4e35-42f7-85ee-1423b162aaae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1725 microversion: 2.20 time: 0.181324 May 23 18:12:40.903990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 400/751] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:40 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:40.922846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ca14744-7b03-4852-adb1-9e79f05d8010 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93c55aa1-6fbf-4677-ab17-011b9bdd265f"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:40.923895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1ca14744-7b03-4852-adb1-9e79f05d8010 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:40.924029 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] validate_networks() for [('1be86e9e-9354-4908-a261-72437ace367c', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:12:40.929946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ca14744-7b03-4852-adb1-9e79f05d8010 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:40.930387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ca14744-7b03-4852-adb1-9e79f05d8010 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:40.931176 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ca14744-7b03-4852-adb1-9e79f05d8010 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:40.932272 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ca14744-7b03-4852-adb1-9e79f05d8010 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:41.152530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:41.284643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1ca14744-7b03-4852-adb1-9e79f05d8010 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.365734 May 23 18:12:41.285441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 401/752] 10.222.0.30 () {62 vars in 1363 bytes} [Mon May 23 18:12:40 2022] POST /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments => generated 188 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:12:41.339770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:12:41.340064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:12:41.340511 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:12:41.341004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:12:41.342816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:12:41.351003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:41.351703 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:41.352492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:41.352939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:41.371008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Getting quotas for project eefd7a6998d24e0189ed1c54dc911737. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:12:41.375050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Getting quotas for user 3bc1f574f2e84b47ad12c67641cc087c and project eefd7a6998d24e0189ed1c54dc911737. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:12:41.386796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:12:41.389129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:12:41.425317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f12b6f8d-7fc8-4436-969c-2a7689b5a829 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:41.426037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f12b6f8d-7fc8-4436-969c-2a7689b5a829 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:41.434016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f12b6f8d-7fc8-4436-969c-2a7689b5a829 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:41.434495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f12b6f8d-7fc8-4436-969c-2a7689b5a829 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:41.434893 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2b4e98d5-20fc-46c1-9c7a-66780b771f86 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567861 May 23 18:12:41.435538 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 352/753] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:12:41.438799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f12b6f8d-7fc8-4436-969c-2a7689b5a829 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:41.438799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f12b6f8d-7fc8-4436-969c-2a7689b5a829 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:41.456362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4e4d3d37-fd71-4b55-bcd2-8085c4de3082 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:41.460775 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4e4d3d37-fd71-4b55-bcd2-8085c4de3082 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:41.560167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f12b6f8d-7fc8-4436-969c-2a7689b5a829 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/action" status: 202 len: 0 microversion: 2.20 time: 0.139601 May 23 18:12:41.560781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 402/754] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 18:12:41 2022] POST /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 18:12:41.574411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:41.578655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:41.591895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:41.592839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:41.593887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:41.594537 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:41.762987 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4e4d3d37-fd71-4b55-bcd2-8085c4de3082 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:41.770550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4e4d3d37-fd71-4b55-bcd2-8085c4de3082 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1219 microversion: 2.1 time: 0.321867 May 23 18:12:41.771270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 353/755] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:41 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1219 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:41.783380 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:41.791987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:41.793560 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:41.794771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e1a8f98b-a067-4cc2-81e2-5ca2a072c6ac tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1751 microversion: 2.20 time: 0.224316 May 23 18:12:41.795497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 403/756] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:41 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:42.787882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:42.789271 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:42.797845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:42.798554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:42.799512 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:42.800272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:42.814013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:42.814683 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:42.826262 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:42.827382 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:42.830076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:42.831056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:42.881649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:42.891791 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-183f1d13-509b-4399-9ec4-4f63c429969a tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1277 microversion: 2.1 time: 0.108226 May 23 18:12:42.892616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 354/757] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:42 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:43.043152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:43.054071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:43.055651 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:43.057988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc6be372-f316-4998-b491-a8b024e5a349 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1753 microversion: 2.20 time: 0.248018 May 23 18:12:43.058559 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 404/758] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:42 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1753 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:12:43.909413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:43.910097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:43.919724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:43.920188 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:43.920933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:43.921359 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:44.077850 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:44.079492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:44.086246 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:44.086941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:44.087870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:44.088485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:44.260339 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:44.269143 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-84abcb47-173c-40c7-84a8-3589d8a7e259 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.363834 May 23 18:12:44.269716 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 355/759] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:43 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:44.483158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:44.491624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:44.493452 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:44.495072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d04e2171-fc07-496c-b3c2-9c5f6646732c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.421553 May 23 18:12:44.495690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 405/760] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:44 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:12:44.522025 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-76febd94-c093-4796-8520-c1607a9dad54 req-2278f79a-e090-4db5-98c8-6423e0a2cc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbc112f-dba4-420e-a380-7d4611377066", "tag": "954e5b18-3a18-4cd2-9856-a37bc68dce9c"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:44.536254 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-76febd94-c093-4796-8520-c1607a9dad54 req-2278f79a-e090-4db5-98c8-6423e0a2cc05 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:44.536702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-76febd94-c093-4796-8520-c1607a9dad54 req-2278f79a-e090-4db5-98c8-6423e0a2cc05 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:44.549132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-76febd94-c093-4796-8520-c1607a9dad54 req-2278f79a-e090-4db5-98c8-6423e0a2cc05 service nova] Creating event network-changed:954e5b18-3a18-4cd2-9856-a37bc68dce9c for instance 0dbc112f-dba4-420e-a380-7d4611377066 on hv-cinder-75078 May 23 18:12:44.554213 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-76febd94-c093-4796-8520-c1607a9dad54 req-2278f79a-e090-4db5-98c8-6423e0a2cc05 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043602 May 23 18:12:44.554859 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 356/761] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:45.286225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:45.286946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:45.294316 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:45.295075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:45.295807 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:45.296302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:45.443749 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:45.452034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-70e609a8-657b-4a50-8cd2-0f3a18a3a723 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.169628 May 23 18:12:45.452602 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 406/762] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:45 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:45.515925 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:45.516692 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:45.523007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:45.523458 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:45.524227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:45.524659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:45.885970 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:45.894871 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:45.896369 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:45.897539 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-810fc09d-c89e-46e1-9c13-b83a7c01ecb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.387019 May 23 18:12:45.898091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 357/763] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:45 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:46.470004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:46.470774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:46.477615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:46.478062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:46.478850 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:46.479286 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:46.610287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:46.619002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4079eb8f-60cc-4be3-82a1-b487ef903925 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.153184 May 23 18:12:46.619684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 407/764] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:46 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:46.915621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:46.916227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:46.923461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:46.923908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:46.924673 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:46.925107 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:47.055181 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:47.063701 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:47.065312 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:47.066523 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-85d42462-c91a-4ccc-9048-0a511aebd97c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154754 May 23 18:12:47.067087 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 358/765] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:46 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:47.637401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:47.638007 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:47.644665 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:47.645114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:47.645870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:47.646350 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:47.783531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:47.790890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-617f6ffc-2cf2-4221-80e8-304042714c14 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.158017 May 23 18:12:47.791448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 408/766] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:47 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:48.085489 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:48.086007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:48.093341 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:48.093783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:48.094553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:48.095018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:48.230199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:48.239599 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:48.241089 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:48.242245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cb5f5a4f-a907-41cc-97de-cd952edf9bb2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.160729 May 23 18:12:48.242828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 359/767] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:48 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:48.808162 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:48.809159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:48.815820 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:48.816563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:48.817593 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:48.818248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:48.954066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:48.961494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc229093-65d0-4d13-ad52-492ce4ad8463 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.157746 May 23 18:12:48.962298 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 409/768] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:48 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:49.261828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:49.263254 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:49.273338 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:49.273999 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:49.274767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:49.275204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:49.583650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:49.593363 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:49.595032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:49.596718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8a844b69-f7fd-4d7c-963a-ffd1bf58b0f4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.339440 May 23 18:12:49.597722 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 360/769] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:49 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:49.978472 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:49.979119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:49.986034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:49.986474 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:49.987263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:49.987689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:50.123306 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:50.130959 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-21b57f40-d2eb-4a30-92e2-bb4d46c36085 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.156257 May 23 18:12:50.131526 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 410/770] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:49 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:50.620222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:50.621441 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:50.628824 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:50.629442 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:50.630524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:50.631030 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:50.654175 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:50.826386 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:50.835302 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:50.836797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:50.837948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7ef7bead-fff6-4aa6-854b-b9b449a1ed16 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.224843 May 23 18:12:50.838694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 361/771] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:50 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:51.148888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:51.149817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:51.156709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:51.157146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:51.157955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:51.158385 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:51.327603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:51.335912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6cb6df26-fdb2-4e39-9904-3eae3f261f7b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.191680 May 23 18:12:51.336587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 411/772] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:51 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:51.860421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:51.861356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:51.867064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:51.868273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=8 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:51.870015 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:51.870518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:51.871511 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:51.871986 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:52.008110 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:52.016844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:52.018368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:52.019543 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00e8b239-2499-47d5-b19f-3af96a38e890 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.163725 May 23 18:12:52.020099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 362/773] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:51 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:52.356680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:52.357282 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:52.363469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:52.363917 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:52.364679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:52.365115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:52.499618 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:52.518038 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-85876c88-260c-49f8-8195-ab47cfc4001c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.156043 May 23 18:12:52.519023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 412/774] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:52 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:52.887377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-b008dcb6-9636-45ae-82c6-258b2603977d req-43fb7a07-21d4-4e7b-8bc4-5bba2ddfada7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbc112f-dba4-420e-a380-7d4611377066", "name": "network-vif-plugged", "status": "completed", "tag": "954e5b18-3a18-4cd2-9856-a37bc68dce9c"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:12:52.897223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b008dcb6-9636-45ae-82c6-258b2603977d req-43fb7a07-21d4-4e7b-8bc4-5bba2ddfada7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:52.897782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b008dcb6-9636-45ae-82c6-258b2603977d req-43fb7a07-21d4-4e7b-8bc4-5bba2ddfada7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:52.918967 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-b008dcb6-9636-45ae-82c6-258b2603977d req-43fb7a07-21d4-4e7b-8bc4-5bba2ddfada7 service nova] Creating event network-vif-plugged:954e5b18-3a18-4cd2-9856-a37bc68dce9c for instance 0dbc112f-dba4-420e-a380-7d4611377066 on hv-cinder-75078 May 23 18:12:52.924642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-b008dcb6-9636-45ae-82c6-258b2603977d req-43fb7a07-21d4-4e7b-8bc4-5bba2ddfada7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042477 May 23 18:12:52.925373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 363/775] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:12:53.037376 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:53.037978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:53.044760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:53.045237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:53.045988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:53.046425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:53.199594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:53.208287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:53.209788 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:53.211000 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bcb1114d-9891-48ab-8106-93510288aa7a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.177501 May 23 18:12:53.211899 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 413/776] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:53 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:53.536940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:53.537631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:53.544615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:53.545068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:53.545825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:53.546264 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:53.699826 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:53.707930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b59e833a-bb2c-401e-874d-25ba475b98ad tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.175193 May 23 18:12:53.709048 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 364/777] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:53 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:54.231014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:54.231662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:54.238674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:54.239322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:54.240069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:54.240506 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:54.372148 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:54.380729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:54.382396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:54.383890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-40388a60-840a-4c5e-a87c-81431f754991 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.157508 May 23 18:12:54.384589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 414/778] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:54 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:54.727549 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:54.728158 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:54.735745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:54.736182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:54.736951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:54.737380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:54.871612 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:54.881591 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0e232827-279f-48de-9ea1-c9c366c55e31 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.157708 May 23 18:12:54.890199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 365/779] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:54 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:55.404016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:55.404634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:55.411342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:55.411788 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:55.412540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:55.412971 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:55.579240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:55.582570 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:55.589093 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:55.590579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:55.591744 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3bb5d9e7-be69-4397-8dbb-1b676ba21f0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.191846 May 23 18:12:55.592296 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 415/780] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:55 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:55.898716 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:55.899542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:55.906683 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:55.907147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:55.907915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:55.908344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:56.049759 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:56.058124 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df8d4ff6-4c53-4e6e-becd-3bd8242b88b9 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.162757 May 23 18:12:56.058914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 366/781] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:55 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:56.612845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:56.613572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:56.623426 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:56.623873 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:56.624645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:56.625073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:56.769261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:56.779841 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:56.781264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:56.782438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-15e654a5-29ef-4719-b128-80b6ad8db725 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.174650 May 23 18:12:56.783127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 416/782] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:56 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:57.077528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:57.080003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:57.086481 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:57.086965 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:57.087728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:57.088381 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:57.221772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:57.230130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-552a82c8-bac2-47a4-be65-9b7efd131c15 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.156426 May 23 18:12:57.230845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 367/783] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:57 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:57.309053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:12:57.309459 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Mon May 23 18:12:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:12:57.975906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:57.978983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:57.983942 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:57.984390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:57.985160 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:57.985587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:58.119666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:58.128545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:58.130399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:58.131659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-69f7b978-79f0-4ea1-af41-52a1cb7b4690 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.332734 May 23 18:12:58.132349 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 417/784] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:57 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:58.248520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:58.249143 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:58.255984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:58.256441 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:58.257207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:58.257648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:58.395989 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:58.404139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-13f91edb-b559-44cc-b1be-669473cc918e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.159830 May 23 18:12:58.404689 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 368/785] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:58 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:12:59.151732 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:59.153164 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:59.160137 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:59.160561 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:59.161329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:59.161759 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:59.298289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:59.306969 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:59.308487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:59.309659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a5c7784a-5699-4ee5-8797-0d0cf69b536a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.162554 May 23 18:12:59.310195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 418/786] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:12:59 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:12:59.421858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:12:59.422423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:12:59.428982 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:59.429427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:59.430183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:12:59.430617 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:12:59.570762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:12:59.578779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-74237b0e-324c-4b86-8706-4ab90f0e1394 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.161474 May 23 18:12:59.579336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 369/787] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:12:59 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:00.328125 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:00.328786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:00.336374 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:00.336967 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:00.337739 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:00.338715 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:00.472542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:00.485500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:00.487545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:00.489039 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7f7a782d-a1fe-4806-89e2-9137ccaccbb8 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.164749 May 23 18:13:00.489958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 419/788] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:00 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:00.596293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:00.597740 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:00.606404 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:00.607229 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:00.608248 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:00.608796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:00.752668 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:00.760572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-058c0b09-28f4-47f8-9ba5-b89b005eae28 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.168557 May 23 18:13:00.761304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 370/789] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:00 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:01.508761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:01.511938 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:01.516841 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:01.517446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:01.518255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:01.518668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:01.662017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:01.671361 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:01.672848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:01.674186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b17bb5ad-5f36-4721-93f0-9e775945fd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.169569 May 23 18:13:01.674895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 420/790] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:01 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:01.778258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:01.778866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:01.785324 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:01.785773 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:01.786533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:01.787006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:01.918863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:01.926630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a6128676-2be8-421b-8f43-7f3c9f3cd04d tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.152922 May 23 18:13:01.927289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 371/791] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:01 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:02.693527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:02.694170 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:02.696436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=52 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:02.702095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:02.702538 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:02.703330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:02.704015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:02.840571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:02.850226 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:02.851765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:02.852905 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b20b3d13-e707-4275-965a-30188ec4cedb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.163683 May 23 18:13:02.853456 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 421/792] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:02 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:02.945034 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:02.945633 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:02.951744 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:02.952189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:02.952940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:02.953371 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:03.101526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:03.111005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a83ba1b-0d47-4909-bf5e-0ff9b0971446 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.169933 May 23 18:13:03.111619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 372/793] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:02 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:13:03.874227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:03.876262 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:03.883826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:03.884643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:03.886369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:03.887044 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:04.032738 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:04.041583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:04.043159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:04.044336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1fdc0b6a-c909-4f79-8821-8dfbd72bea81 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.176855 May 23 18:13:04.044901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 422/794] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:03 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:04.127525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:04.128104 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:04.135382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:04.135795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:04.136654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:04.137079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:04.216055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:13:04.216307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:13:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:13:04.280484 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:04.288155 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e7ede9d8-7248-4d7c-ad6a-cb2e29475783 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.164573 May 23 18:13:04.288712 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 373/795] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:04 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:05.063098 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:05.063662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:05.070247 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:05.070693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:05.071461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:05.071885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:05.201095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:05.209956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:05.211518 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:05.212666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2ef85d1b-17e2-4894-86b0-a901aac2bb50 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.153588 May 23 18:13:05.213848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 423/796] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:05 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:05.306552 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:05.307992 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:05.314218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:05.314675 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:05.315411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:05.315886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:05.450858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:05.458576 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0354e493-f0c8-4788-bcd5-9897f3988856 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.155990 May 23 18:13:05.459192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 374/797] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:05 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:13:06.231735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:06.232359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:06.238945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:06.239448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:06.240230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:06.240703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:06.371189 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:06.380134 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:06.381644 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:06.382815 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ae137e21-dd3d-4413-ade0-6ab057a4fce4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.155269 May 23 18:13:06.383368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 424/798] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:06 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:06.476229 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:06.476847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:06.483364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:06.484898 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:06.485348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:06.486166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:06.486607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:06.623574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:06.631183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c7dea934-2bc4-45df-8591-81349fc51148 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.159224 May 23 18:13:06.631743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 375/799] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:06 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:07.402014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:07.402612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:07.409063 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:07.409502 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:07.410251 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:07.410678 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:07.542001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:07.550449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:07.551983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:07.553135 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-326e846c-45c0-430a-9f15-a57bd9cc6345 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.155711 May 23 18:13:07.553696 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 425/800] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:07 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:07.648364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:07.648979 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:07.656258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:07.656642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:07.657399 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:07.657833 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:07.788841 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:07.796928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b7ac00be-ffeb-43ab-b179-8afcafd0d34e tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.152577 May 23 18:13:07.797485 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 376/801] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:07 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:08.571465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:08.572066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:08.579743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:08.580189 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:08.580946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:08.581374 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:08.708951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:08.717379 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:08.718921 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:08.720072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b98bce0-a4d5-4103-8b7c-97b86a059c8a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.152501 May 23 18:13:08.720625 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 426/802] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:08 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:08.813872 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:08.814487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:08.820958 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:08.821409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:08.822324 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:08.822914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:08.954272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:08.962003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5c42ad06-837f-4a25-a1c0-852cfc5f6ce5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.152040 May 23 18:13:08.962567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 377/803] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:08 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:09.738829 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:09.739458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:09.746311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:09.746782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:09.747531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:09.747958 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:09.878578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:09.887254 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:09.888766 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:09.889917 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ab3c321c-7d01-4375-9d13-a9f34403e502 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.155004 May 23 18:13:09.890476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 427/804] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:09 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:09.980267 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:09.980891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:09.987356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:09.987806 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:09.988568 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:09.989007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:10.114982 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:10.118334 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:10.123343 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-24cfac13-f750-42c0-b20f-71e5c3eec2b5 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.147950 May 23 18:13:10.123907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 378/805] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:09 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:10.908547 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:10.909143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:10.915853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:10.916302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:10.917049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:10.917472 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:11.045248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:11.053544 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:11.055056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:11.056243 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-89824978-7756-4586-9c9b-f047febcd432 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.151575 May 23 18:13:11.057169 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 428/806] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:10 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:11.140312 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:11.140928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:11.147540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:11.147990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:11.148751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:11.149188 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:11.289006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:11.297085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa9dba78-21e2-44ad-a834-0ef965f4a9b2 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.160730 May 23 18:13:11.297650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 379/807] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:11 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:12.075568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:12.076104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:12.083139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:12.083587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:12.084348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:12.084786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:12.212435 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:12.221437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:12.222960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:12.224109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ef7966b6-4db3-4e98-a99b-34e18300bd26 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.153367 May 23 18:13:12.224655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 429/808] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:12 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:12.313256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:12.313918 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:12.320420 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:12.320866 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:12.321615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:12.322046 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:12.449582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:12.456868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b38acdc7-59f9-47e9-9189-3d4c2ddc4a85 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.147433 May 23 18:13:12.457435 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 380/809] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:12 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:13.243367 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:13.244224 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:13.250934 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:13.251386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:13.252151 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:13.252588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:13.385544 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:13.395097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:13.396601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:13.397747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-621fcf74-ffa1-4322-a084-bd6074e6ec0d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.158340 May 23 18:13:13.398293 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 430/810] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:13 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:13.473181 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:13.473794 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:13.480870 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:13.481326 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:13.482089 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:13.482528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:13.612501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:13.619959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8c272a1d-0976-4533-af5a-68ca48386796 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.150594 May 23 18:13:13.620518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 381/811] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:13 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:14.417477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:14.418119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:14.424995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:14.425458 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:14.426209 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:14.426646 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:14.553409 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:14.562023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:14.563716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:14.564875 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0fb8b191-2f56-4637-b057-c6996bdca30d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.152225 May 23 18:13:14.565435 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 431/812] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:14 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:14.637251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:14.637873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:14.644364 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:14.644818 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:14.645585 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:14.646028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:14.772306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:14.780389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-beac937d-a0c7-47bb-9712-edf11a0c905b tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.147498 May 23 18:13:14.780946 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 382/813] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:14 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:15.583263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:15.583884 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:15.590447 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:15.590926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:15.591676 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:15.592107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:15.609937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:15.725506 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:15.734226 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:15.735752 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:15.736903 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-71abcd11-201b-4693-a97c-47b0ca55e63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.157507 May 23 18:13:15.737454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 432/814] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:15 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:15.797069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:15.797605 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:15.803964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:15.804412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:15.805163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:15.805595 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:15.946618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:15.954576 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-05b79eb8-e5c6-47be-9fbd-d303d1a27706 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.161407 May 23 18:13:15.955155 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 383/815] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:15 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:16.755832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:16.757079 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:16.764515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:16.765274 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:16.766392 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:16.766909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:16.896124 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:16.905641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:16.907470 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:16.908763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1c8da36a-4149-48e6-a8e6-097a8431e5f2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.157128 May 23 18:13:16.909317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 433/816] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:16 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:16.971303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:16.971909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:16.978422 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:16.979038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:16.979796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:16.980226 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:17.111896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:17.119359 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c489b7f5-c451-4952-9329-6a38e19b48da tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.151815 May 23 18:13:17.119927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 384/817] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:16 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:17.927016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:17.927593 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:17.934129 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:17.934566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:17.935378 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:17.935807 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:18.065893 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:18.074735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:18.076206 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:18.077335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30eecfc1-77c8-4d19-af0a-33f239c4cd11 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154121 May 23 18:13:18.077887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 434/818] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:17 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:18.137227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:18.137932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:18.144438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:18.144889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:18.145685 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:18.146127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:18.277034 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:18.284433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7d26fbb8-9daf-4b0e-a1b5-851e93b9a779 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.152083 May 23 18:13:18.284987 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 385/819] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:18 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:19.095463 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:19.096004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:19.102450 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:19.103557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:19.104336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:19.104772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:19.233462 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:19.242211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:19.244431 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:19.245584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8574339f-9ee5-436e-be62-437c0dd16271 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154176 May 23 18:13:19.246139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 435/820] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:19 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:19.301286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:19.301924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:19.309706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:19.310152 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:19.310948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:19.311381 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:19.443015 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:19.450470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5cbecf4d-d8cb-4819-a155-126443021114 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.153074 May 23 18:13:19.451064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 386/821] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:19 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:20.264555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:20.265163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:20.271748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:20.272218 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:20.272965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:20.273401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:20.402063 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:20.410664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:20.412498 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:20.413641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8da72337-5fda-4612-915f-d5cf04739983 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.152993 May 23 18:13:20.414192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 436/822] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:20 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:20.467213 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:20.467769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:20.474528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:20.475167 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:20.475926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:20.476355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:20.610041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:20.617763 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1bd7977c-df85-4660-a1a9-6a9687c78320 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.154500 May 23 18:13:20.618310 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 387/823] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:20 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:21.432255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:21.432939 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:21.439424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:21.439864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:21.440611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:21.441066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:21.575927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:21.584523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:21.586035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:21.587834 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6c0e174-90db-4a50-aaa5-866a8a256f8d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.159235 May 23 18:13:21.588397 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 437/824] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:21 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:21.635867 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:21.636503 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:21.643178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:21.643620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:21.644381 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:21.644815 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:21.778504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:21.785845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a716e12c-64b3-450e-be88-340e15b9793f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.154766 May 23 18:13:21.786403 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 388/825] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:21 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:22.606103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:22.606712 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:22.612761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:22.613232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:22.613984 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:22.614415 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:22.741965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:22.751103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:22.752600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:22.753733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ee915d2e-85ba-4e7a-bef5-e590589cd2e4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.152225 May 23 18:13:22.754288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 438/826] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:22 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:22.802555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:22.803232 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:22.810348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:22.810836 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:22.811596 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:22.812032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:22.942375 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:22.949785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8f23df14-54fd-4f93-bd60-7c92c97accae tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.151064 May 23 18:13:22.950344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 389/827] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:22 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:23.773203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:23.773807 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:23.781448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:23.781894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:23.782650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:23.783107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:23.921164 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:23.929433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:23.931106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:23.932227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-876a5885-da15-4e48-8377-2e5069385b29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.162924 May 23 18:13:23.932772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 439/828] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:23 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:23.967185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:23.967827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:23.974212 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:23.974657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:23.975446 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:23.975883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:24.105579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:24.113125 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-29b2f469-4ddc-4bc8-9eac-5ac8e0e2afe6 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.149830 May 23 18:13:24.113630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 390/829] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:23 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:24.951152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:24.951764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:24.958225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:24.958672 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:24.959449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:24.959880 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:25.089287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:25.098401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:25.099944 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:25.101085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-675acf05-c1da-44e4-bdfc-df75fd6b79bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154687 May 23 18:13:25.101639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 440/830] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:24 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:25.129176 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:25.130128 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:25.137182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:25.137630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:25.138397 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:25.138862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:25.270951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:25.279141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a78faad4-10b9-4cbd-8666-7606927b834f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1319 microversion: 2.1 time: 0.153814 May 23 18:13:25.279700 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 391/831] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:25 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:26.120420 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:26.120947 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:26.127562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:26.128010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:26.128761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:26.129190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:26.261089 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:26.269494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:26.271067 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:26.272359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8d6b329b-d8da-499f-9f50-3b7f6da30aa5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.156176 May 23 18:13:26.273080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 441/832] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:26 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:26.296551 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:26.297170 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:26.303598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:26.304045 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:26.304802 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:26.305240 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:26.437144 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:26.444594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21c2bcd7-945d-4149-a8f7-140f5dd60735 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1507 microversion: 2.1 time: 0.151862 May 23 18:13:26.445151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 392/833] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:26 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:26.461085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c04b90a-60a4-4131-96dc-5c0200c5687f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d04906bd-8da7-4e22-a8cb-95f368c8f17d", "device": "/dev/sdb"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:13:26.462914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c04b90a-60a4-4131-96dc-5c0200c5687f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:26.469010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c04b90a-60a4-4131-96dc-5c0200c5687f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:26.469449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c04b90a-60a4-4131-96dc-5c0200c5687f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:26.470193 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c04b90a-60a4-4131-96dc-5c0200c5687f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:26.470619 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c04b90a-60a4-4131-96dc-5c0200c5687f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:26.703733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c04b90a-60a4-4131-96dc-5c0200c5687f tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "POST /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246395 May 23 18:13:26.707287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 442/834] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:13:26 2022] POST /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:13:27.291697 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:27.292271 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:27.298283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:27.298877 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:27.299537 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:27.301048 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:27.427782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:27.436183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:27.437694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:27.438885 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-94b9ff29-184d-4c9b-a9c9-5ccd7948e4cd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.151995 May 23 18:13:27.439445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 393/835] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:27 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:28.458461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:28.459188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:28.465911 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:28.466351 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:28.467122 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:28.467549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:28.595828 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:28.605397 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:28.606924 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:28.608080 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d6cdb3c7-4525-43e8-8c80-4fba8dd3edb7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154450 May 23 18:13:28.608647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 443/836] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:28 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:29.626853 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:29.627471 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:29.634245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:29.634693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:29.635484 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:29.635924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:29.766809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:29.776085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:29.778243 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:29.779727 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7d12adee-fe0d-4371-8aa5-3cb06af4fe29 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.156812 May 23 18:13:29.780400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 394/837] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:29 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:30.798968 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:30.799585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:30.805978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:30.806418 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:30.807195 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:30.807626 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:30.944497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:30.955506 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:30.957017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:30.958171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-76baea3e-6cc5-4788-a1d1-3feddc8ea698 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.163116 May 23 18:13:30.959239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 444/838] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:30 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:31.977787 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:31.978491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:31.987620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:31.988068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:31.988838 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:31.989277 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:32.008157 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:32.122431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:32.130998 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:32.132494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:32.133652 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-541e612b-4369-4472-ab6f-84321af3d4f5 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.160354 May 23 18:13:32.134215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 395/839] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:31 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:33.152349 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:33.153076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:33.155608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=48 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:33.161582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:33.162034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:33.162839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:33.163279 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:33.291029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:33.299482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:33.300930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:33.302076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b59b1781-af5b-42fe-a81d-322c9f34f582 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154300 May 23 18:13:33.302630 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 445/840] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:33 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:34.321293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:34.321892 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:34.328934 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:34.329378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:34.330132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:34.330563 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:34.460742 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:34.469030 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:34.470525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:34.471709 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9a163d86-287e-48de-867f-6956ec2fcb98 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154394 May 23 18:13:34.472263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 396/841] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:34 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:35.489451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:35.490127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:35.497352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:35.497821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:35.498566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:35.499020 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:35.630284 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:35.644378 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:35.645879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:35.647061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6e749f1f-a679-40b3-92e2-a273934067ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.161584 May 23 18:13:35.647610 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 446/842] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:35 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:36.666841 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:36.667905 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:36.670242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=44 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:36.675620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:36.676067 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:36.676819 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:36.677250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:36.808373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:36.816647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:36.818135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:36.819352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b7beaca8-a91d-4de9-b395-6a3e55e75b89 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.156521 May 23 18:13:36.820110 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 397/843] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:36 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:37.838181 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:37.839435 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:37.846315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:37.846797 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:37.847586 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:37.848017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:37.978022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:37.981574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:37.987290 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:37.988818 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:37.989959 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e8798eca-da81-42be-be33-207b3009c764 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.155900 May 23 18:13:37.990509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 447/844] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:37 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:38.904930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-c9593a44-ad09-48d3-977a-16d6e9a2ded5 req-06b0efae-bfa5-4af7-a1d0-f2a7243f032d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebec7dc8-9547-4dac-9035-078304c6793c", "name": "network-vif-plugged", "status": "completed", "tag": "8a5c394c-2439-4849-a7b4-278598a8a204"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:13:38.913470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-c9593a44-ad09-48d3-977a-16d6e9a2ded5 req-06b0efae-bfa5-4af7-a1d0-f2a7243f032d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:38.914024 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-c9593a44-ad09-48d3-977a-16d6e9a2ded5 req-06b0efae-bfa5-4af7-a1d0-f2a7243f032d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:38.925319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-c9593a44-ad09-48d3-977a-16d6e9a2ded5 req-06b0efae-bfa5-4af7-a1d0-f2a7243f032d service nova] Creating event network-vif-plugged:8a5c394c-2439-4849-a7b4-278598a8a204 for instance ebec7dc8-9547-4dac-9035-078304c6793c on hv-cinder-75078 May 23 18:13:38.930289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-c9593a44-ad09-48d3-977a-16d6e9a2ded5 req-06b0efae-bfa5-4af7-a1d0-f2a7243f032d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090605 May 23 18:13:38.930891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 398/845] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:13:39.008275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:39.009041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:39.016821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:39.017329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:39.018312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:39.018961 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:39.164630 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:39.174048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:39.175610 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:39.176762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ff1c2825-4617-41fe-af10-37b1abefd69e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.172515 May 23 18:13:39.177312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 448/846] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:39 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:40.195651 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:40.196363 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:40.202395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:40.202872 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:40.203622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:40.204053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:40.337407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:40.345924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:40.347471 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:40.348632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-68f199ed-e788-44df-b494-69b0c5539085 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.157693 May 23 18:13:40.349185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 399/847] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:40 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:41.367284 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:41.367813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:41.374348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:41.374825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:41.375585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:41.376018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:41.512119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:41.519930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:41.521440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:41.522652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-00000ae4-5bb3-470b-a149-580ac897232c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.159289 May 23 18:13:41.523422 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 449/848] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:41 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:42.541337 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:42.541879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:42.552284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:42.552731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:42.553485 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:42.553937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:42.683250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:42.691790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:42.693272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:42.694430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d190ba09-bd9e-42f6-8e16-a4e16ac3f0bf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.157024 May 23 18:13:42.695038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 400/849] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:42 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:43.712416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:43.713011 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:43.719646 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:43.720086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:43.720828 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:43.721292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:43.848485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:43.857563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:43.859274 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:43.860432 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc022939-4b52-4c08-ad3d-21e7c14cab96 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.151844 May 23 18:13:43.860985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 450/850] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:43 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:44.878529 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:44.879421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:44.885829 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:44.886284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:44.887071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:44.887508 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:45.021362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:45.030115 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:45.031650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:45.032802 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa6130fb-7c21-4f0d-a736-34b161801083 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.158157 May 23 18:13:45.033350 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 401/851] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:44 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:46.052112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:46.052647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:46.059778 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:46.060220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:46.060991 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:46.061405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:46.191457 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:46.200111 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:46.201611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:46.202778 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e00a6680-3a8b-4251-aced-092b07e471c6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154792 May 23 18:13:46.203330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 451/852] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:46 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:47.220909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:47.221515 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:47.227958 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:47.228405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:47.229164 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:47.229601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:47.357090 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:47.365445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:47.366979 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:47.368141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d9d1cca5-da28-4572-9fb7-177c84de38f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.151162 May 23 18:13:47.368693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 402/853] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:47 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:48.388215 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:48.388816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:48.396400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:48.396849 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:48.397949 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:48.398381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:48.526029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:48.535405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:48.536898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:48.538035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-674a472b-8f82-4559-99a4-10716653eb13 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154249 May 23 18:13:48.538587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 452/854] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:48 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:49.561068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:49.561666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:49.568127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:49.568570 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:49.569320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:49.569748 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:49.699785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:49.708141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:49.709629 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:49.710803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce008a2b-2863-4668-981d-faabe20f3444 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.154001 May 23 18:13:49.711354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 403/855] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:49 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:50.729383 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:50.730924 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:50.737390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:50.737834 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:50.738587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:50.739049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:50.876209 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:50.884891 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:50.887087 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:50.888260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f0b0a167-9b66-4531-9798-805ad1200b20 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.162860 May 23 18:13:50.888824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 453/856] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:50 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:51.908144 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:51.908858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:51.918219 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:51.918786 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:51.920129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:51.920645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:52.224827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:52.233896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:52.238454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:52.243249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-067da19f-8cdc-49b5-87f3-ae549040f470 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1809 microversion: 2.20 time: 0.337898 May 23 18:13:52.243249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 404/857] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:51 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1809 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:53.260245 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:53.261628 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:53.270659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:53.272192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:53.272192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:53.272546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:53.418015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:53.428086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:53.429674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:53.431407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c3f395fd-123e-4f30-b787-61efa1bdbefa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1796 microversion: 2.20 time: 0.174995 May 23 18:13:53.431973 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 454/858] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:13:53 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1796 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:13:55.437356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:55.437987 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:55.444410 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:55.444861 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:55.445622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:55.446057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:55.527032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lazy-loading 'services' on Instance uuid 0dbc112f-dba4-420e-a380-7d4611377066 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:13:55.600389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f442e2e1-a12b-47eb-bdbe-bf27f7c03461 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066/os-volume_attachments/d04906bd-8da7-4e22-a8cb-95f368c8f17d" status: 202 len: 0 microversion: 2.1 time: 0.167340 May 23 18:13:55.600966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 405/859] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:13:55 2022] DELETE /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066/os-volume_attachments/d04906bd-8da7-4e22-a8cb-95f368c8f17d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:13:56.715390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:56.715873 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:56.722512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:56.722990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:56.723745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:56.724177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:56.748572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:13:56.831931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67883d4c-2da5-49dd-a95b-0af45e08ff9c tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 204 len: 0 microversion: 2.1 time: 0.120422 May 23 18:13:56.832648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 455/860] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:13:56 2022] DELETE /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:13:56.842006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:56.842721 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:56.849620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:56.850070 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:56.850851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:56.851291 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:56.984175 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:56.991713 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b1225eea-6740-4545-8ceb-1e24e2120919 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1513 microversion: 2.1 time: 0.154426 May 23 18:13:56.992273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 406/861] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:56 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:58.009907 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:58.011167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:58.017567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:58.018025 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:58.018878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:58.019308 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:58.150442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:58.158741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0ae3654a-3dde-4b7b-a8da-0375bc7ee399 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1513 microversion: 2.1 time: 0.153108 May 23 18:13:58.159304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 456/862] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:58 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:59.175644 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:13:59.176252 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:13:59.183308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:59.183790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:59.184540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:59.184970 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:59.384071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc1f574f2e84b47ad12c67641cc087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eefd7a6998d24e0189ed1c54dc911737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:13:59.395522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae1f1263-a4fb-4e0d-b0a4-6f9c1ea43307 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 200 len: 1513 microversion: 2.1 time: 0.223810 May 23 18:13:59.396597 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 407/863] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:13:59 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:13:59.645605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-22b5a53f-e970-4990-9415-83101937bc02 req-ac425d90-ea41-4b8f-8c49-9fe9958e607b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbc112f-dba4-420e-a380-7d4611377066", "name": "network-vif-deleted", "tag": "954e5b18-3a18-4cd2-9856-a37bc68dce9c"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:13:59.654071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-22b5a53f-e970-4990-9415-83101937bc02 req-ac425d90-ea41-4b8f-8c49-9fe9958e607b service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:13:59.654509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-22b5a53f-e970-4990-9415-83101937bc02 req-ac425d90-ea41-4b8f-8c49-9fe9958e607b service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:13:59.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-22b5a53f-e970-4990-9415-83101937bc02 req-ac425d90-ea41-4b8f-8c49-9fe9958e607b service nova] Creating event network-vif-deleted:954e5b18-3a18-4cd2-9856-a37bc68dce9c for instance 0dbc112f-dba4-420e-a380-7d4611377066 on hv-cinder-75078 May 23 18:13:59.669724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-22b5a53f-e970-4990-9415-83101937bc02 req-ac425d90-ea41-4b8f-8c49-9fe9958e607b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228512 May 23 18:13:59.670281 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 457/864] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:14:00.413917 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:00.414525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] [instance: 0dbc112f-dba4-420e-a380-7d4611377066] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:00.421559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:00.422004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:00.422779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:00.423210 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:00.436646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] HTTP exception thrown: Instance 0dbc112f-dba4-420e-a380-7d4611377066 could not be found. May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Request method failure captured: May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 HTTP/1.1 May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii84ALDi0v-uNQUm1mX4_n-6POXtsi5XqLDE24umjRyp4BnFxIolMxkW_7t1zlcaRFsGc8EApczzhFDsmGAFJYHgQVztPme5BNW3pVbBe151chR7SgMxvvEdTG81E2JaQoCYkONp3CwqPWdmTdqGh0NXMwqsnJiga2aBYguGVMaOJKOg May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: eefd7a6998d24e0189ed1c54dc911737 May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1009617757 May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:14:00.438479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eefd7a6998d24e0189ed1c54dc911737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesSnapshotTestJSON-1009617757 May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: eefd7a6998d24e0189ed1c54dc911737 May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1009617757 May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesSnapshotTestJSON-1009617757-project May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 3bc1f574f2e84b47ad12c67641cc087c May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesSnapshotTestJSON-1009617757-project May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 0dbc112f-dba4-420e-a380-7d4611377066 could not be found. May 23 18:14:00.439797 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '0dbc112f-dba4-420e-a380-7d4611377066'} May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbc112f-dba4-420e-a380-7d4611377066 could not be found. May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:14:00.440536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbc112f-dba4-420e-a380-7d4611377066 could not be found. May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbc112f-dba4-420e-a380-7d4611377066 could not be found. May 23 18:14:00.441752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:14:00.443133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] Returning 404 to user: Instance 0dbc112f-dba4-420e-a380-7d4611377066 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:14:00.443133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-41e17121-11a2-4b6f-9a99-3fe0340bf1e4 tempest-VolumesSnapshotTestJSON-1009617757 tempest-VolumesSnapshotTestJSON-1009617757-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066" status: 404 len: 111 microversion: 2.1 time: 0.029722 May 23 18:14:00.443133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 408/865] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:00 2022] GET /compute/v2.1/servers/0dbc112f-dba4-420e-a380-7d4611377066 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:14:38.281378 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:38.282131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:38.502943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e7397b97-85a2-45e7-a510-3fddd86e4ccd tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ce1f8fe-693d-447a-9716-75e346efcb8c"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:14:38.504412 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e7397b97-85a2-45e7-a510-3fddd86e4ccd tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:38.510867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7397b97-85a2-45e7-a510-3fddd86e4ccd tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:38.511325 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7397b97-85a2-45e7-a510-3fddd86e4ccd tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:38.512101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7397b97-85a2-45e7-a510-3fddd86e4ccd tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:38.512546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7397b97-85a2-45e7-a510-3fddd86e4ccd tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:38.750942 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7397b97-85a2-45e7-a510-3fddd86e4ccd tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474576 May 23 18:14:38.751621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 458/866] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:14:38 2022] POST /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:14:40.421198 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=23 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:40.421945 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:40.525015 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:40.525511 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:40.536258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:40.536710 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:40.537538 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:40.537984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:40.622403 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lazy-loading 'services' on Instance uuid 03538a0b-c9de-4f9a-826d-72679e1fde88 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:14:40.693495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0345adbd-4bca-4bb5-9e61-add877a8b6d5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-volume_attachments/a78771e7-a652-4f3d-a6ed-dc1f51132b6c" status: 202 len: 0 microversion: 2.1 time: 0.277163 May 23 18:14:40.694151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 409/867] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:14:40 2022] DELETE /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-volume_attachments/a78771e7-a652-4f3d-a6ed-dc1f51132b6c => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:14:46.258898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:14:46.259951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:46.266442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:46.266937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:46.267699 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:46.268139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:46.291216 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lazy-loading 'flavor' on Instance uuid af994d05-2cb5-4804-ac2c-46d19e2d04b1 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:14:46.412222 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a0b4f8ff-16f1-4030-8ad8-c73dd7ebb57a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/action" status: 200 len: 32 microversion: 2.1 time: 0.158353 May 23 18:14:46.412816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 459/868] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:14:46 2022] POST /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:14:46.423221 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:46.423928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:46.430195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:46.430646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:46.431448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:46.431889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:46.645064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:46.653586 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab032d8e-aca1-4bf2-91f6-f76460dc5eb7 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.235237 May 23 18:14:46.654150 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 410/869] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:46 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:47.070086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-27486cfc-a679-4bbf-92e0-6e291fb5cadf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:14:47.076986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27486cfc-a679-4bbf-92e0-6e291fb5cadf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:47.077423 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27486cfc-a679-4bbf-92e0-6e291fb5cadf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:47.101484 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-27486cfc-a679-4bbf-92e0-6e291fb5cadf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Going to try to stop instance {{(pid=117929) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 18:14:47.145950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-27486cfc-a679-4bbf-92e0-6e291fb5cadf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action" status: 202 len: 0 microversion: 2.1 time: 0.080447 May 23 18:14:47.146742 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 460/870] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:14:47 2022] POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:14:47.160279 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:47.160902 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:47.167616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:47.168103 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:47.168885 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:47.169326 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:47.316218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:47.323755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-174500ba-2c8b-4d80-b29e-9c663ef7f451 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.167393 May 23 18:14:47.324411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 411/871] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:47 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:47.672022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:47.672710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:47.679245 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:47.679680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:47.680424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:47.680850 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:47.810328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:47.818170 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1719d255-22d1-453a-b204-5ba95c6fb670 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.150941 May 23 18:14:47.818746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 461/872] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:47 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:48.341478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:48.342083 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:48.348494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:48.348940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:48.349695 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:48.350125 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:48.481756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:48.489184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc24fd7d-4d84-4c20-96d5-b66fc6f2c064 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.151751 May 23 18:14:48.489751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 412/873] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:48 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:48.836402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:48.837012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:48.844174 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:48.844615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:48.845364 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:48.845793 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:48.976637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:48.985399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e37648b4-12e9-43ae-9917-9d20c6ff5c83 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.152751 May 23 18:14:48.986024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 462/874] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:48 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:49.507833 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:49.508394 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:49.515554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:49.516003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:49.516767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:49.517204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:49.646049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:49.654173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5c1bbe61-c574-4085-8d97-ce17760b148c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.150666 May 23 18:14:49.654746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 413/875] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:49 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:49.982169 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e3350a9-2e1a-40f5-8987-c703157999b2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:14:49.983230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e3350a9-2e1a-40f5-8987-c703157999b2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:49.989557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e3350a9-2e1a-40f5-8987-c703157999b2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:49.990001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e3350a9-2e1a-40f5-8987-c703157999b2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:49.990790 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e3350a9-2e1a-40f5-8987-c703157999b2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:49.991213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e3350a9-2e1a-40f5-8987-c703157999b2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:50.002631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:50.003540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:50.009637 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:50.010021 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:50.011873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:50.012393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:50.064358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e3350a9-2e1a-40f5-8987-c703157999b2 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/action" status: 202 len: 0 microversion: 2.1 time: 0.086317 May 23 18:14:50.065263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 463/876] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:14:49 2022] POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:14:50.074453 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:50.075327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:50.082423 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:50.082944 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:50.083766 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:50.084349 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:50.160951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:50.170359 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c175d86a-fbbd-40f3-b2c4-3494d0e6ee18 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.171043 May 23 18:14:50.179568 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 414/877] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:49 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:50.236962 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:50.244966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b0989338-7c34-4597-b05f-15f0d325e37c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1753 microversion: 2.1 time: 0.175663 May 23 18:14:50.246194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 464/878] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:50 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:50.671258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:50.672011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:50.678541 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:50.679035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:50.679836 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:50.680275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:50.812408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:50.820104 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d523bd3a-936f-447f-bfeb-bb29f960a0cc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.152704 May 23 18:14:50.820672 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 415/879] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:50 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:51.187535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:51.188148 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:51.194668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:51.195149 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:51.195943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:51.196415 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:51.265372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:51.266157 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:51.272405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:51.272942 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:51.273716 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:51.274163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:51.328589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:51.336687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0b71edc8-37a9-480f-9a8e-e84344d0335d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.153857 May 23 18:14:51.337261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 465/880] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:51 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:51.418788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:51.426828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ffdf608e-c263-461f-99a0-9ce66ebcff0d tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.165974 May 23 18:14:51.427389 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 416/881] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:51 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:51.837852 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:51.838467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:51.845685 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:51.846315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:51.847146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:51.847580 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:51.980806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:51.988331 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-219f53b0-431c-46b9-962f-a8cd2f9116ff tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.154399 May 23 18:14:51.988901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 466/882] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:51 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:52.353802 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:52.354865 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:52.361289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:52.361736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:52.362513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:52.362948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:52.444792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:52.445405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:52.452063 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:52.452510 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:52.453270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:52.453700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:52.496105 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:52.504601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3796aaa1-fef7-4393-ade6-8b12ed1676d4 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.155193 May 23 18:14:52.505253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 417/883] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:52 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:52.594150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:52.602027 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7931437-d5ae-41fe-bec8-b030eebbab60 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.161323 May 23 18:14:52.602578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 467/884] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:52 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:53.006524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:53.007162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:53.014294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:53.014768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:53.015536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:53.015970 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:53.152558 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:53.160132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2c005433-2d47-43b0-b84e-dba9516fe399 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.157589 May 23 18:14:53.160692 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 418/885] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:53 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:53.521141 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:53.521745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:53.529522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:53.529965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:53.530737 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:53.531264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:53.620650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:53.621264 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:53.628189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:53.628896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:53.629665 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:53.630105 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:53.673494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:53.681476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f6343298-70e8-4614-806e-956ef5c7fb16 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.164173 May 23 18:14:53.682049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 468/886] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:53 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:53.779285 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:53.787250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-538d03e2-2779-42e0-aa87-b0dbce946128 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.170921 May 23 18:14:53.787822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 419/887] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:53 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:54.178764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:54.179372 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:54.186402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:54.187245 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:54.188028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:54.188461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:54.192662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:54.329873 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:54.337556 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-622c5ffd-03fb-4b27-a580-55ef73f0d4a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.162725 May 23 18:14:54.338117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 469/888] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:54 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:54.698359 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:54.699003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:54.705502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:54.706121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:54.706941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:54.707388 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:54.808204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:54.808879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:54.816670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:54.817115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:54.817872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:54.818297 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:54.855953 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:54.864009 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f542856f-3c33-4304-8a88-716e23644a2b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.169598 May 23 18:14:54.864669 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 420/889] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:54 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:54.960048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:54.968656 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-13f8563f-28ea-4bdf-af13-07cc3c29315b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.165578 May 23 18:14:54.969216 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 470/890] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:54 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:55.361190 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:55.361848 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:55.368417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:55.368962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:55.369727 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:55.370335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:55.504706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:55.513372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aff43d00-c5b9-4f99-9d40-c50b61e62d37 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.156256 May 23 18:14:55.513941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 421/891] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:55 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:55.882062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:55.882587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:55.889757 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:55.890198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:55.890973 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:55.891405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:55.985733 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:55.986520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:55.993335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:55.993788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:55.994561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:55.995584 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:56.027602 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:56.035779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c8c4818e-7edc-4773-a04f-802010884add tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.157845 May 23 18:14:56.036354 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 471/892] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:55 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:56.139966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:56.147855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-96cb11ac-3dc1-470b-b7bc-330bac26399b tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.166036 May 23 18:14:56.148420 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 422/893] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:55 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:56.532106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:56.532747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:56.538900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:56.539347 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:56.540135 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:56.540572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:56.673340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:56.680677 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f8646204-e369-4e24-a7d6-bd70de9c155c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.152717 May 23 18:14:56.681262 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 472/894] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:56 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:57.053618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:57.054230 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:57.061332 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:57.061773 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:57.062526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:57.062991 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:57.165247 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:57.165869 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:57.172263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:57.172718 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:57.173498 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:57.173937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:57.192659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:57.201983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e48967a5-e5b6-42ef-9807-e5be6728180a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.152771 May 23 18:14:57.202557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 423/895] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:57 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:57.318521 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:57.327156 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e1b293b4-ec8a-4f08-97ff-1b3a3e0fcd6f tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.165848 May 23 18:14:57.327726 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 473/896] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:57 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:57.697936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:57.698548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:57.704556 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:57.705016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:57.705770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:57.706208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:57.835288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:57.838882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:57.843524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d3751f4a-466d-4073-85fd-df2f19692897 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.149523 May 23 18:14:57.844082 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 424/897] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:57 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:58.218621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:58.219260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:58.225463 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:58.225999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:58.227019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:58.227576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:58.345513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:58.346153 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:58.354001 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:58.354484 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:58.355247 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:58.355729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:58.501071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:58.509520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-71e0be01-973e-4a7b-8bfe-fb31b80a1b34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.169075 May 23 18:14:58.510311 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 425/898] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:58 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:58.510987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:58.519710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce5ff6f4-41d1-4d4a-8ca5-c40ac692aa44 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.305372 May 23 18:14:58.520268 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 474/899] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:58 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:58.860673 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:58.861280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:58.867212 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:58.867655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:58.868402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:58.868831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:58.998681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:59.007471 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e71b899a-1dfa-48ed-b2ba-edfb1b099730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.150561 May 23 18:14:59.008041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 426/900] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:58 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:14:59.527352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:59.528057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:59.534632 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:59.535119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:59.535870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:59.536300 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:59.537375 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:14:59.537987 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:14:59.544668 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:59.545119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:59.545883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:14:59.546320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:14:59.675825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:59.682126 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:14:59.687697 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-14f8bab1-420f-495a-b488-5e54f693cf41 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.154385 May 23 18:14:59.688578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 427/901] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:59 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:14:59.691192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-65e0c1cc-c890-4f62-b987-47af56cc5174 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.167646 May 23 18:14:59.691764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 475/902] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:14:59 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:00.025961 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:00.026578 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:00.032628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.033077 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.033836 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.034272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.162988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:00.171049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9f7dd55a-ee39-4c9a-a87c-d20ed01d1120 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.149018 May 23 18:15:00.171614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 428/903] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:00 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:00.561147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-78a343e0-99a1-4165-8cb3-232e02cace49 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:00.561660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-78a343e0-99a1-4165-8cb3-232e02cace49 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:00.568075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a343e0-99a1-4165-8cb3-232e02cace49 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.568517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a343e0-99a1-4165-8cb3-232e02cace49 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.569266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a343e0-99a1-4165-8cb3-232e02cace49 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.569691 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78a343e0-99a1-4165-8cb3-232e02cace49 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.601715 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-78a343e0-99a1-4165-8cb3-232e02cace49 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments/93c55aa1-6fbf-4677-ab17-011b9bdd265f" status: 200 len: 194 microversion: 2.20 time: 0.044882 May 23 18:15:00.602261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 476/904] 10.222.0.30 () {60 vars in 1453 bytes} [Mon May 23 18:15:00 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments/93c55aa1-6fbf-4677-ab17-011b9bdd265f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:15:00.664555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:00.665149 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:00.671727 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.672173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.672920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.673353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.706240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:00.706882 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:00.713069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.713512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.714261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.714722 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.754639 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lazy-loading 'services' on Instance uuid ebec7dc8-9547-4dac-9035-078304c6793c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:15:00.828746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-33cb6293-6315-43d8-b562-453f1bc09f2a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments/93c55aa1-6fbf-4677-ab17-011b9bdd265f" status: 202 len: 0 microversion: 2.20 time: 0.167974 May 23 18:15:00.829636 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 429/905] 10.222.0.30 () {60 vars in 1456 bytes} [Mon May 23 18:15:00 2022] DELETE /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments/93c55aa1-6fbf-4677-ab17-011b9bdd265f => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 18:15:00.834801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:00.835504 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:00.843356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.843931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.844902 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.845407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.857892 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:00.866527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de0d7cfe-2121-4694-ae0b-d6e118712527 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.163970 May 23 18:15:00.867127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 477/906] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:00 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:15:00.872032 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c9194558-7f6e-493f-ad88-5ef7ff1b5a2f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:00.873019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c9194558-7f6e-493f-ad88-5ef7ff1b5a2f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:00.879368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9194558-7f6e-493f-ad88-5ef7ff1b5a2f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.879806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9194558-7f6e-493f-ad88-5ef7ff1b5a2f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.880573 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9194558-7f6e-493f-ad88-5ef7ff1b5a2f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:00.881002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9194558-7f6e-493f-ad88-5ef7ff1b5a2f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:00.917403 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c9194558-7f6e-493f-ad88-5ef7ff1b5a2f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049234 May 23 18:15:00.917957 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 478/907] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 18:15:00 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:15:00.991464 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:01.000354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-624fb6b1-8414-4b98-8273-c15534ce3658 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1758 microversion: 2.1 time: 0.169641 May 23 18:15:01.000910 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 430/908] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:00 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:01.188802 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:01.189436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:01.195385 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:01.195826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:01.196568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:01.197004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:01.323709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:01.331540 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6f7c97d8-2029-4f46-b710-7ea2130b2cd1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.146659 May 23 18:15:01.332092 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 479/909] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:01 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:01.884158 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:01.884848 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:01.891515 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:01.891998 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:01.892757 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:01.893200 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:01.929651 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6a0ef88-cd30-4e8e-92ae-28ed596f89a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:01.930709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6a0ef88-cd30-4e8e-92ae-28ed596f89a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:01.937216 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ef88-cd30-4e8e-92ae-28ed596f89a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:01.937663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ef88-cd30-4e8e-92ae-28ed596f89a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:01.938435 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ef88-cd30-4e8e-92ae-28ed596f89a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:01.938902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ef88-cd30-4e8e-92ae-28ed596f89a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:01.971532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6a0ef88-cd30-4e8e-92ae-28ed596f89a0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046048 May 23 18:15:01.972090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 480/910] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 18:15:01 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 18:15:02.017510 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:02.018152 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:02.022511 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:02.024386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:02.024870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:02.025647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:02.026087 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:02.031418 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-efb8356a-75ff-4245-995c-2b4498dd39d8 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.151069 May 23 18:15:02.032171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 431/911] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:01 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:02.178130 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:02.186092 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9af479cb-813e-4a88-bf02-131a3e313b64 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1761 microversion: 2.1 time: 0.172487 May 23 18:15:02.187608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 481/912] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:02 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1761 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:15:02.348719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:02.349357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:02.355315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:02.355854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:02.356789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:02.357218 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:02.491145 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:02.499652 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1aa0559b-bbc9-4d8b-afe1-1aeec224bc23 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1674 microversion: 2.1 time: 0.154788 May 23 18:15:02.500228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 432/913] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:02 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:02.984043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-357fbdd6-36a7-45ff-95eb-55fcd21df6c9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:02.984980 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-357fbdd6-36a7-45ff-95eb-55fcd21df6c9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:02.991694 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-357fbdd6-36a7-45ff-95eb-55fcd21df6c9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:02.992144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-357fbdd6-36a7-45ff-95eb-55fcd21df6c9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:02.992939 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-357fbdd6-36a7-45ff-95eb-55fcd21df6c9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:02.993376 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-357fbdd6-36a7-45ff-95eb-55fcd21df6c9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.022218 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-357fbdd6-36a7-45ff-95eb-55fcd21df6c9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043024 May 23 18:15:03.022772 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 482/914] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 18:15:02 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:03.049632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:03.050276 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:03.056216 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.056664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.057421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.057858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.082747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:03.083241 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:03.089198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.089642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.091127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.091496 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.122567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:15:03.190803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:03.200868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c7d6cace-4d88-4b21-a52c-50fc91a2a024 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.155066 May 23 18:15:03.201634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 433/915] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:03 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:03.201762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-34aac4a2-188b-4f7c-9b6b-72ee1013ca12 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 204 len: 0 microversion: 2.20 time: 0.122422 May 23 18:15:03.205948 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 483/916] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 18:15:03 2022] DELETE /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 18:15:03.215922 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:03.216534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:03.222474 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.222950 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.223732 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.224183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.357470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:03.365377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:03.366918 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:03.368074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cae90bde-de38-4542-b363-c9e69ed44d03 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.156613 May 23 18:15:03.368639 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 434/917] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:03 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:03.518233 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:03.518951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:03.524915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.525350 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.526097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.526524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.530648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:03.658647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:03.665968 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f6df65dd-0b2d-459b-8582-acb1f10e40d8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1651 microversion: 2.1 time: 0.151981 May 23 18:15:03.666520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 484/918] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:03 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1651 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:03.683600 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-944b1b58-4301-411e-9da6-4074fc0c0267 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:03.690205 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-944b1b58-4301-411e-9da6-4074fc0c0267 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.690653 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-944b1b58-4301-411e-9da6-4074fc0c0267 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.712652 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-944b1b58-4301-411e-9da6-4074fc0c0267 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Going to try to start instance {{(pid=117928) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 18:15:03.754268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-944b1b58-4301-411e-9da6-4074fc0c0267 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action" status: 202 len: 0 microversion: 2.1 time: 0.074290 May 23 18:15:03.754913 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 435/919] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:15:03 2022] POST /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:15:03.762996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:03.763604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:03.769667 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.770107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.771048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:03.771479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:03.901403 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:03.909909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f439f16-7dc5-46da-bbd6-664dcb9fd687 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1660 microversion: 2.1 time: 0.150833 May 23 18:15:03.910470 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 485/920] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:03 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1660 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:04.219813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:04.220430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:04.226614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:04.227099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:04.227856 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:04.228293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:04.358552 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:04.367431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b3d29252-5db5-4e2e-846b-dd8b046c3deb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.153103 May 23 18:15:04.367985 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 436/921] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:04 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:04.387655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:04.388271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:04.394835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:04.395289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:04.396055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:04.396495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:04.526646 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:04.536441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:04.538117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:04.539333 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-25fdf438-d640-40c8-88f8-0367ace066aa tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.156288 May 23 18:15:04.539898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 486/922] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:04 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:04.928632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:04.929472 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:04.936800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:04.937247 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:04.938000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:04.938433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:05.129554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:05.137033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa1a1924-8b0a-4623-b349-6ea1b4918987 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1660 microversion: 2.1 time: 0.212996 May 23 18:15:05.137602 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 437/923] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:04 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1660 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:05.385032 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:05.385773 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:05.392421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:05.393035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:05.393707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:05.394149 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:05.557437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:05.558110 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:05.564225 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:05.564667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:05.565453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:05.565881 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:05.660528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:05.669691 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-15edfb3b-2ae7-4551-8779-0edc4bd3af12 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.288524 May 23 18:15:05.670271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 487/924] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:05 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:05.700670 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:05.708725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:05.710219 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:05.711426 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d908a74f-2e41-405b-8ffb-7116d3f777b2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 200 len: 1724 microversion: 2.20 time: 0.157813 May 23 18:15:05.711977 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 438/925] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:05 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:15:06.154494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:06.155137 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:06.162865 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:06.163325 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:06.164323 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:06.164519 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:06.278076 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-8068e309-7dbe-42d6-8ae8-52f7a776cb06 req-d7c54eef-f100-4761-8388-f8024703f43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebec7dc8-9547-4dac-9035-078304c6793c", "name": "network-vif-deleted", "tag": "8a5c394c-2439-4849-a7b4-278598a8a204"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:06.293764 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-8068e309-7dbe-42d6-8ae8-52f7a776cb06 req-d7c54eef-f100-4761-8388-f8024703f43b service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:06.294369 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-8068e309-7dbe-42d6-8ae8-52f7a776cb06 req-d7c54eef-f100-4761-8388-f8024703f43b service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:06.310000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-8068e309-7dbe-42d6-8ae8-52f7a776cb06 req-d7c54eef-f100-4761-8388-f8024703f43b service nova] Creating event network-vif-deleted:8a5c394c-2439-4849-a7b4-278598a8a204 for instance ebec7dc8-9547-4dac-9035-078304c6793c on hv-cinder-75078 May 23 18:15:06.315813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-8068e309-7dbe-42d6-8ae8-52f7a776cb06 req-d7c54eef-f100-4761-8388-f8024703f43b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123174 May 23 18:15:06.316988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 439/926] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:15:06.357644 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:06.365538 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-79e1b978-2672-4394-bca4-83661112f0a1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1664 microversion: 2.1 time: 0.215705 May 23 18:15:06.366301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 488/927] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:06 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1664 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:06.687807 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:06.689943 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:06.700283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:06.701200 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:06.702297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:06.702942 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:06.722001 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:06.731011 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:06.732902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:06.740520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:06.741492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:06.742548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:06.743585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:06.762402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] HTTP exception thrown: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Request method failure captured: May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c HTTP/1.1 May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii817BOJJD8xDgzpjRhkutgckcmYHWrYZmM5k2-sxtWSeXnimG1V2qLN3C00SkdfqzYjDBvlpnq8sB57NDx6YhSewcrlwcccCkmMQXrdQ4w9Wmk6raBGCjVDdRwzkG5drVlYzBVlHWypCWmW1wlkzBkFeGVzt0LFM9R7OKIH11hu-jkc May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Openstack-Nova-Api-Version: 2.20 May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:15:06.770460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 32e9879d092b4c819f1f5607f42cc364 May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:15:06.772086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'ebec7dc8-9547-4dac-9035-078304c6793c'} May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:15:06.772908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:15:06.774256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:06.779083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Returning 404 to user: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:15:06.780427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db92f131-4752-41b2-b0b2-2243724046ec tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 404 len: 111 microversion: 2.20 time: 0.054739 May 23 18:15:06.781244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 489/928] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:06 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 23 18:15:06.790748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f5d9b3d3-b45b-4840-ad2b-f4906e645051 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '.version_select at 0x7f8c1c408670>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:06.824856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f5d9b3d3-b45b-4840-ad2b-f4906e645051 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079657828" status: 204 len: 0 microversion: 2.20 time: 0.037401 May 23 18:15:06.826206 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 490/929] 10.222.0.30 () {60 vars in 1261 bytes} [Mon May 23 18:15:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079657828 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 18:15:06.858314 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:06.870997 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-54f8bdb3-5c89-4c8e-85f5-f8bc520fa590 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.187802 May 23 18:15:06.871732 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 440/930] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:06 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:07.534323 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-24221c97-1aa1-44e8-981d-30936fa33754 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'create', calling method: .version_select at 0x7f8c167e4700>, body: {"keypair": {"name": "tempest-keypair-2109014482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXhSYlCLKd9B1mduM59+jlmnNYhSrEcXwWN0e6zBV0mOLkUBY7f4u8sBQYw2E3v+tA9bQteP/tyf72ytQw77o0xY5QcrZn7l6mHpBKhiXsVqtQUoirEx5DEUY/GXofwJg=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:07.550350 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-24221c97-1aa1-44e8-981d-30936fa33754 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for project c69b4fff47194d4fbd1188521b31dce8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:15:07.554300 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-24221c97-1aa1-44e8-981d-30936fa33754 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for user 32e9879d092b4c819f1f5607f42cc364 and project c69b4fff47194d4fbd1188521b31dce8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:15:07.578741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-24221c97-1aa1-44e8-981d-30936fa33754 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050252 May 23 18:15:07.579568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 491/931] 10.222.0.30 () {62 vars in 1199 bytes} [Mon May 23 18:15:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 18:15:07.890028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:07.890646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:07.898028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:07.898707 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:07.899530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:07.900149 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:08.063399 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:08.073910 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-26f51366-82e4-49d4-84f8-0f27d8a8b956 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.188679 May 23 18:15:08.075590 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 441/932] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:07 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:08.983158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-224606286", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d2af0e3-a19a-418d-bc30-8536d057041d"}], "security_groups": [{"name": "tempest-securitygroup--1873604517"}], "key_name": "tempest-keypair-2109014482", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:08.990610 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:09.094122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:09.095755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:09.102660 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:09.103167 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:09.103911 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] validate_networks() for [('3d2af0e3-a19a-418d-bc30-8536d057041d', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:15:09.104033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:09.104388 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:09.254009 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:09.262774 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-55e3f61c-8835-49de-b0ec-708b745362c2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.173142 May 23 18:15:09.270745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 442/933] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:09 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:15:09.675310 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:15:09.675739 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:15:09.676209 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:15:09.676617 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:15:09.677063 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:15:09.686396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:09.686883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:09.687679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:09.688112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:09.704808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for project c69b4fff47194d4fbd1188521b31dce8. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:15:09.708753 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Getting quotas for user 32e9879d092b4c819f1f5607f42cc364 and project c69b4fff47194d4fbd1188521b31dce8. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:15:09.719937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:15:09.722193 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:15:09.769023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af6a23aa-eee6-48dc-8e72-bff03f2919d9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.790740 May 23 18:15:09.769671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 492/934] 10.222.0.30 () {62 vars in 1187 bytes} [Mon May 23 18:15:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 18:15:09.784245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93e8bca0-297b-4cc7-a242-279d5a8ceec7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:09.784245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93e8bca0-297b-4cc7-a242-279d5a8ceec7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:09.839409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93e8bca0-297b-4cc7-a242-279d5a8ceec7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:09.846834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93e8bca0-297b-4cc7-a242-279d5a8ceec7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:09.848501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93e8bca0-297b-4cc7-a242-279d5a8ceec7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:09.849758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93e8bca0-297b-4cc7-a242-279d5a8ceec7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1281 microversion: 2.20 time: 0.072918 May 23 18:15:09.850436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 443/935] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:09 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:10.279866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:10.280476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:10.287190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:10.287633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:10.288391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:10.288816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:10.430524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:10.442438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9aaedb60-d82e-4091-b0bb-21b40f35702f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1734 microversion: 2.1 time: 0.166349 May 23 18:15:10.443751 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 493/936] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:10 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:10.867962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:10.868572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:10.871015 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=73 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:10.876305 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:10.876750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:10.877505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:10.877937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:10.938441 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:10.946209 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:10.947734 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:10.948878 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f84db63a-fecb-4f3a-be35-d452b304879e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1333 microversion: 2.20 time: 0.084762 May 23 18:15:10.949439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 444/937] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:10 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:11.461589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:11.462210 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:11.469349 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:11.469802 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:11.470597 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:11.471063 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:11.922071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:11.930307 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2a78013c-3fe0-4dff-bc31-bf48fb82d839 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1714 microversion: 2.1 time: 0.472732 May 23 18:15:11.930900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 494/938] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:11 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1714 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:15:11.967890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:11.969103 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:11.975440 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:11.976096 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:11.977101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:11.977544 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:11.988182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:11.991365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:12.002651 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:12.003394 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:12.004564 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:12.004684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:12.074315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:12.082454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:12.083983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:12.085085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-750a63d1-7989-4124-9da5-add00051d614 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1339 microversion: 2.20 time: 0.122214 May 23 18:15:12.085923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 445/939] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:11 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:12.145914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] HTTP exception thrown: Cannot 'detach_volume' instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 while it is in vm_state rescued May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Request method failure captured: May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments/9ce1f8fe-693d-447a-9716-75e346efcb8c HTTP/1.1 May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii8127MkRXqbu9k9Nm02gGmw0dbE0r3UiP2ANN9q4-I1aSilsO_JAozGVgDSK_GRtdLX48pvQNSule4mkoeLNDfo3CowdogXzk6uDwy9pnvn6S_1Gz7-vtCHYsfELPbfQXjf7xtXXMjvgHMvcUQJVbxxdVUL7YIYcwbkXwZo2e8yNT2s May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:15:12.147535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: a57822c1558143d38ad17326a742c370 May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:15:12.149238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Cannot 'detach_volume' instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 while it is in vm_state rescued May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'server_id': 'af994d05-2cb5-4804-ac2c-46d19e2d04b1', 'id': '9ce1f8fe-693d-447a-9716-75e346efcb8c'} May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:15:12.153314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 while it is in vm_state rescued May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 while it is in vm_state rescued May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:15:12.154887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Returning 409 to user: Cannot 'detach_volume' instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 while it is in vm_state rescued {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:15:12.156061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9317e4fa-10c0-4383-8c6f-d1ecd41a9665 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments/9ce1f8fe-693d-447a-9716-75e346efcb8c" status: 409 len: 152 microversion: 2.1 time: 0.165242 May 23 18:15:12.156061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 495/940] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:15:11 2022] DELETE /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments/9ce1f8fe-693d-447a-9716-75e346efcb8c => generated 152 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 23 18:15:12.159481 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dd049d52-a49d-414e-b321-c3d01862c426 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:12.160021 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dd049d52-a49d-414e-b321-c3d01862c426 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:12.167199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd049d52-a49d-414e-b321-c3d01862c426 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:12.167714 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd049d52-a49d-414e-b321-c3d01862c426 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:12.168495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd049d52-a49d-414e-b321-c3d01862c426 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:12.169041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd049d52-a49d-414e-b321-c3d01862c426 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:12.235641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dd049d52-a49d-414e-b321-c3d01862c426 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "POST /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/action" status: 202 len: 0 microversion: 2.1 time: 0.080441 May 23 18:15:12.238889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 446/941] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:15:12 2022] POST /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:15:12.245351 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:12.246680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:12.252858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:12.253788 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:12.254646 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:12.255048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:12.493929 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:12.503717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-673cf7e9-69e2-4675-a714-c1fb3749e1e2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1722 microversion: 2.1 time: 0.262546 May 23 18:15:12.504824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 496/942] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:12 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:13.106192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:13.107088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:13.114689 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:13.115163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:13.116128 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:13.116571 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:13.349678 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-c7bb95ea-0e28-42eb-b903-41262df98e53 req-9b1f5084-7298-4f09-866c-f0469ba00a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bb8e05-88ff-4af1-a5d6-23d2348b5178", "tag": "b8d8717a-a013-430f-b363-b78a1d29d611"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:13.363658 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c7bb95ea-0e28-42eb-b903-41262df98e53 req-9b1f5084-7298-4f09-866c-f0469ba00a77 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:13.364178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c7bb95ea-0e28-42eb-b903-41262df98e53 req-9b1f5084-7298-4f09-866c-f0469ba00a77 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:13.384745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-c7bb95ea-0e28-42eb-b903-41262df98e53 req-9b1f5084-7298-4f09-866c-f0469ba00a77 service nova] Creating event network-changed:b8d8717a-a013-430f-b363-b78a1d29d611 for instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 on hv-cinder-75078 May 23 18:15:13.390843 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-c7bb95ea-0e28-42eb-b903-41262df98e53 req-9b1f5084-7298-4f09-866c-f0469ba00a77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044793 May 23 18:15:13.391432 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 497/943] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:15:13.515269 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:13.522257 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:13.523105 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:13.528864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:13.530533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:13.530930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:13.531734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:13.531832 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-59adfbe4-0fc4-4502-bf2d-024dd5f7ddd1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.430997 May 23 18:15:13.532437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:13.532655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 447/944] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:13 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:13.532873 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:13.665453 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:13.673908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9612c74e-bbd7-4cc7-94df-4c0ce4bd335a tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1722 microversion: 2.1 time: 0.156248 May 23 18:15:13.674471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 498/945] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:13 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:15:14.549968 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:14.550584 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:14.557502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:14.558110 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:14.558913 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:14.559356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:14.685191 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:14.692224 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:14.692838 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:14.693376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:14.694940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:14.696061 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae4eeee0-288d-4018-be20-021171446811 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.150275 May 23 18:15:14.696624 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 448/946] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:14 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:14.699585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:14.700040 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:14.700805 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:14.701240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:14.829017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:14.837115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a128c3cc-c9be-475e-a61b-e6741318eb28 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1722 microversion: 2.1 time: 0.148844 May 23 18:15:14.837675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 499/947] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:14 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:15:15.713532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:15.714147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:15.721338 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:15.721785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:15.722544 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:15.723021 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:15.855022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:15.855635 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:15.862049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:15.862491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:15.863281 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:15.863708 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:15.870542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:15.879106 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:15.880610 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:15.881720 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-900ad5f7-8f4a-4d95-bf64-f4b697a05883 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.172199 May 23 18:15:15.882282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 449/948] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:15 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:16.072409 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:16.080858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a36fae0c-f91c-4d94-8910-e70e932c5ece tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1728 microversion: 2.1 time: 0.229754 May 23 18:15:16.081425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 500/949] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:15 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:16.097338 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-01d1d2e5-081b-4841-bd1e-f31f9b02d384 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:16.097834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-01d1d2e5-081b-4841-bd1e-f31f9b02d384 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:16.103784 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01d1d2e5-081b-4841-bd1e-f31f9b02d384 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:16.104235 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01d1d2e5-081b-4841-bd1e-f31f9b02d384 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:16.105083 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01d1d2e5-081b-4841-bd1e-f31f9b02d384 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:16.105522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01d1d2e5-081b-4841-bd1e-f31f9b02d384 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:16.184259 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-01d1d2e5-081b-4841-bd1e-f31f9b02d384 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090667 May 23 18:15:16.184850 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 450/950] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:15:16 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:15:16.900048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:16.900687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:16.907890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:16.908343 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:16.909104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:16.909539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:17.047057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:17.055353 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:17.056899 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:17.058366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f57869e6-7c52-418f-94b4-95964dca27bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.162077 May 23 18:15:17.059415 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 501/951] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:16 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:17.069477 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-88001398-948c-4f73-abb4-526d65c9748b req-c8eea950-38ff-41b2-932f-5875e5a31fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af994d05-2cb5-4804-ac2c-46d19e2d04b1", "tag": "3e5629ff-ce51-43da-9392-add0febcff5b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:17.078950 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-88001398-948c-4f73-abb4-526d65c9748b req-c8eea950-38ff-41b2-932f-5875e5a31fdd service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:17.079393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-88001398-948c-4f73-abb4-526d65c9748b req-c8eea950-38ff-41b2-932f-5875e5a31fdd service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:17.090768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-88001398-948c-4f73-abb4-526d65c9748b req-c8eea950-38ff-41b2-932f-5875e5a31fdd service nova] Creating event network-changed:3e5629ff-ce51-43da-9392-add0febcff5b for instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 on hv-cinder-75078 May 23 18:15:17.095706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-88001398-948c-4f73-abb4-526d65c9748b req-c8eea950-38ff-41b2-932f-5875e5a31fdd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040020 May 23 18:15:17.096303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 451/952] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:15:18.076463 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:18.076974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:18.083550 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:18.083996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:18.084746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:18.085175 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:18.216104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:18.223967 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:18.225504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:18.226623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-086cb29f-693f-48f6-8fa9-dfef7b8cee27 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.154263 May 23 18:15:18.227186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 502/953] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:18 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:19.111073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-1f345c72-2173-414b-b3eb-4898ff64fa57 req-9aef60da-8c21-461a-bd1b-9b86f5ce7c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af994d05-2cb5-4804-ac2c-46d19e2d04b1", "tag": "3e5629ff-ce51-43da-9392-add0febcff5b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:19.119226 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1f345c72-2173-414b-b3eb-4898ff64fa57 req-9aef60da-8c21-461a-bd1b-9b86f5ce7c75 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:19.119666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1f345c72-2173-414b-b3eb-4898ff64fa57 req-9aef60da-8c21-461a-bd1b-9b86f5ce7c75 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:19.131550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-1f345c72-2173-414b-b3eb-4898ff64fa57 req-9aef60da-8c21-461a-bd1b-9b86f5ce7c75 service nova] Creating event network-changed:3e5629ff-ce51-43da-9392-add0febcff5b for instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 on hv-cinder-75078 May 23 18:15:19.137431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-1f345c72-2173-414b-b3eb-4898ff64fa57 req-9aef60da-8c21-461a-bd1b-9b86f5ce7c75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030798 May 23 18:15:19.138023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 452/954] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:15:19.246002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:19.246749 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:19.254339 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:19.254824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:19.255584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:19.256320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:19.479289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:19.487837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:19.489349 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:19.490442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-742ed6e9-e792-458e-adcd-b0352f16136a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.249246 May 23 18:15:19.491023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 503/955] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:19 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:20.509861 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:20.511451 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:20.513402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:20.519737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:20.520187 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:20.520949 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:20.521380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:20.651463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:20.659255 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:20.660743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:20.661842 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ff166515-d9ce-4e62-8aa0-df04a7bea39e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.156304 May 23 18:15:20.662398 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 453/956] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:20 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:21.199558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-2815e9eb-93a9-4c69-84e9-42b90cc4c453 req-f950b239-b925-4755-9029-a7d08aad9c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bb8e05-88ff-4af1-a5d6-23d2348b5178", "name": "network-vif-plugged", "status": "completed", "tag": "b8d8717a-a013-430f-b363-b78a1d29d611"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:21.204299 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:21.204943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=10 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:21.210420 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-2815e9eb-93a9-4c69-84e9-42b90cc4c453 req-f950b239-b925-4755-9029-a7d08aad9c01 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:21.210899 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-2815e9eb-93a9-4c69-84e9-42b90cc4c453 req-f950b239-b925-4755-9029-a7d08aad9c01 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:21.223008 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-2815e9eb-93a9-4c69-84e9-42b90cc4c453 req-f950b239-b925-4755-9029-a7d08aad9c01 service nova] Creating event network-vif-plugged:b8d8717a-a013-430f-b363-b78a1d29d611 for instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 on hv-cinder-75078 May 23 18:15:21.227931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-2815e9eb-93a9-4c69-84e9-42b90cc4c453 req-f950b239-b925-4755-9029-a7d08aad9c01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032139 May 23 18:15:21.228576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 504/957] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:15:21.678827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:21.679435 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:21.686292 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:21.686757 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:21.687519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:21.687951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:21.818901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:21.827434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:21.828930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:21.830041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0f00fbca-caab-47a6-aac1-ad22a9e163b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.155138 May 23 18:15:21.830589 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 454/958] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:21 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:22.849707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:22.850304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:22.857475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:22.857915 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:22.858739 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:22.859110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:22.876914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:22.991999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:23.000358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:23.001910 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:23.003317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-03a99112-42b5-4e43-8be6-5578a3e062a1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1407 microversion: 2.20 time: 0.158266 May 23 18:15:23.003876 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 505/959] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:22 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:24.020767 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:24.021390 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:24.028473 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:24.028933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:24.030348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:24.030840 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:24.164182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:24.172835 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:24.174352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:24.175554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e6450deb-2757-4b46-8b59-b8503a4da1ee tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1599 microversion: 2.20 time: 0.158771 May 23 18:15:24.176117 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 455/960] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:15:24 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:15:24.192564 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c50c7e0-e7a3-469c-b6b3-cb912ca36781 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:24.193053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4c50c7e0-e7a3-469c-b6b3-cb912ca36781 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:24.199842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c50c7e0-e7a3-469c-b6b3-cb912ca36781 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:24.200289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c50c7e0-e7a3-469c-b6b3-cb912ca36781 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:24.201043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c50c7e0-e7a3-469c-b6b3-cb912ca36781 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:24.201477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c50c7e0-e7a3-469c-b6b3-cb912ca36781 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:24.277400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4c50c7e0-e7a3-469c-b6b3-cb912ca36781 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088534 May 23 18:15:24.278027 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 506/961] 10.222.0.30 () {60 vars in 1315 bytes} [Mon May 23 18:15:24 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:15:25.404285 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-3196be71-6417-4da8-bd76-058f17370c9c req-7e269aaa-42f0-4c86-b7c6-d61d0035e283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bb8e05-88ff-4af1-a5d6-23d2348b5178", "tag": "b8d8717a-a013-430f-b363-b78a1d29d611"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:25.413431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3196be71-6417-4da8-bd76-058f17370c9c req-7e269aaa-42f0-4c86-b7c6-d61d0035e283 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:25.413876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3196be71-6417-4da8-bd76-058f17370c9c req-7e269aaa-42f0-4c86-b7c6-d61d0035e283 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:25.434316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-3196be71-6417-4da8-bd76-058f17370c9c req-7e269aaa-42f0-4c86-b7c6-d61d0035e283 service nova] Creating event network-changed:b8d8717a-a013-430f-b363-b78a1d29d611 for instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 on hv-cinder-75078 May 23 18:15:25.440877 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-3196be71-6417-4da8-bd76-058f17370c9c req-7e269aaa-42f0-4c86-b7c6-d61d0035e283 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040648 May 23 18:15:25.442351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 456/962] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:15:40.152024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:40.152762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:40.258414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:40.258945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:40.265668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:40.266110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:40.266894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:40.267323 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:40.291753 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:15:40.365312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b30875dc-93aa-48e0-8b4a-88cef16483bd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 204 len: 0 microversion: 2.1 time: 0.214609 May 23 18:15:40.366001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 507/963] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:15:40 2022] DELETE /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:15:40.372723 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=25 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:40.373690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:40.378490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:40.379217 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:40.386970 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:40.387417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:40.388177 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:40.388610 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:40.526426 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:40.534076 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f539732f-3c2a-4693-905b-cb65f277283c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1578 microversion: 2.1 time: 0.163143 May 23 18:15:40.534635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 457/964] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:40 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:41.552048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:41.552743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:41.559362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:41.559801 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:41.560553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:41.560986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:41.689954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:41.697337 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d92cd4f6-6e84-403f-880a-76cf2dbb9fa0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1578 microversion: 2.1 time: 0.149484 May 23 18:15:41.697923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 508/965] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:41 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:42.715464 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:42.716210 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:42.723693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:42.724377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:42.725526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:42.726105 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:42.869256 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:42.877913 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c8de2a01-38bc-47fe-a570-3d9c9a87e371 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 200 len: 1578 microversion: 2.1 time: 0.166727 May 23 18:15:42.888064 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 458/966] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:42 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:43.095729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-592308ee-8ea1-4e42-9532-57a0e5a4926d req-f68cc23f-aa57-4fc7-a702-f09f6626eb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38d8037-09eb-4c41-b6d8-7a2126321b0b", "name": "network-vif-deleted", "tag": "cfcde4fb-a3d1-4e66-a4ca-3d5933501427"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:43.106295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-592308ee-8ea1-4e42-9532-57a0e5a4926d req-f68cc23f-aa57-4fc7-a702-f09f6626eb84 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:43.107267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-592308ee-8ea1-4e42-9532-57a0e5a4926d req-f68cc23f-aa57-4fc7-a702-f09f6626eb84 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:43.121692 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-592308ee-8ea1-4e42-9532-57a0e5a4926d req-f68cc23f-aa57-4fc7-a702-f09f6626eb84 service nova] Creating event network-vif-deleted:cfcde4fb-a3d1-4e66-a4ca-3d5933501427 for instance d38d8037-09eb-4c41-b6d8-7a2126321b0b on hv-cinder-75078 May 23 18:15:43.128633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-592308ee-8ea1-4e42-9532-57a0e5a4926d req-f68cc23f-aa57-4fc7-a702-f09f6626eb84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036468 May 23 18:15:43.129723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 509/967] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:15:43.895541 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:43.896156 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:43.902894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:43.903348 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:43.904112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:43.904599 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:43.918760 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] HTTP exception thrown: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Request method failure captured: May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b HTTP/1.1 May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii84Fo5o7NoIUMuKVO-r3n143JV7ia4m31xCkqj7I2N8_74rhJiXqScVp5ILL7ZdbLD_XNjCu0o92eL-xEvSSfH8WLYdevYPLDAK7jVfkIHG4vZjF_9uumK04eDG6uNMjL3W9RsRWoP7bRdpaQ_7IhmF_-ORw2gEUZ_WXnX4FwaOVdAU May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:15:43.920409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-TestVolumeBootPattern-292797858 May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-TestVolumeBootPattern-292797858-project May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 06b8d18d37e7467f84841ec6ac0080fb May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-TestVolumeBootPattern-292797858-project May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:15:43.922192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'd38d8037-09eb-4c41-b6d8-7a2126321b0b'} May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:15:43.923342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:15:43.924705 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:15:43.925805 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Returning 404 to user: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:15:43.925805 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6b9dbaaf-c6fc-4f98-907b-c02c7696c733 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 404 len: 111 microversion: 2.1 time: 0.030167 May 23 18:15:43.925805 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 459/968] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:43 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:15:43.970596 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-470094869", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1307402015", "security_groups": [{"name": "tempest-secgroup-smoke-1146479828"}], "block_device_mapping_v2": [{"uuid": "d26846b2-d89c-4524-b55b-d9701aa2ca28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1d3a1f7-b777-4042-a243-d14c937aea70"}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:44.089285 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] validate_networks() for [('a1d3a1f7-b777-4042-a243-d14c937aea70', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:15:44.448020 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:15:44.448580 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:15:44.448924 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:15:44.449327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:15:44.449734 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:15:44.458433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:44.458909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:44.459693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:44.460120 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:44.476551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:15:44.481194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for user 06b8d18d37e7467f84841ec6ac0080fb and project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:15:44.538363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:15:44.540623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d26846b2-d89c-4524-b55b-d9701aa2ca28',volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:15:44.664486 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5f630996-7a9f-4f95-bf67-1deec904038d tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698102 May 23 18:15:44.665146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 510/969] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:15:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:15:44.675823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1fd7ba6e-0214-4446-9dc2-46a72687e5b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:44.676559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1fd7ba6e-0214-4446-9dc2-46a72687e5b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:44.731016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1fd7ba6e-0214-4446-9dc2-46a72687e5b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:44.737725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1fd7ba6e-0214-4446-9dc2-46a72687e5b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1094 microversion: 2.1 time: 0.065809 May 23 18:15:44.738280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 460/970] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:44 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:45.755108 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:45.756475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:45.765652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:45.766181 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:45.767182 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:45.767900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:45.851240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:45.859658 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1d3b2cde-5a5e-4091-a827-00bafb93f3b1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1210 microversion: 2.1 time: 0.109415 May 23 18:15:45.860236 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 511/971] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:45 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:46.878484 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:46.879141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:46.888097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:46.888873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:46.889779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:46.890465 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:47.032132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:47.039922 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04ce1024-b44a-434f-a66a-f830e237a80b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.165773 May 23 18:15:47.040730 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 461/972] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:46 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:47.047144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-a8d1b5aa-8227-41bb-923b-712337eda9a8 req-5abd0236-fabc-4b8b-9d2f-d101b22900b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e", "tag": "cdf88afb-8339-4273-a911-bc3379093276"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:47.061876 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-a8d1b5aa-8227-41bb-923b-712337eda9a8 req-5abd0236-fabc-4b8b-9d2f-d101b22900b2 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:47.062325 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-a8d1b5aa-8227-41bb-923b-712337eda9a8 req-5abd0236-fabc-4b8b-9d2f-d101b22900b2 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:47.078927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-a8d1b5aa-8227-41bb-923b-712337eda9a8 req-5abd0236-fabc-4b8b-9d2f-d101b22900b2 service nova] Creating event network-changed:cdf88afb-8339-4273-a911-bc3379093276 for instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e on hv-cinder-75078 May 23 18:15:47.084614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-a8d1b5aa-8227-41bb-923b-712337eda9a8 req-5abd0236-fabc-4b8b-9d2f-d101b22900b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043309 May 23 18:15:47.085207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 512/973] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:15:48.057719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:48.058332 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:48.064815 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:48.065271 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:48.066029 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:48.066467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:48.208112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:48.215719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-07882f8e-f4cf-4438-b365-6e245cda33dd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.161859 May 23 18:15:48.216287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 462/974] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:48 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:49.233551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:49.234252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:49.240504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:49.240953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:49.241711 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:49.242146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:49.374285 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:49.382096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ee4b2a20-6cc4-496b-8a35-991ffafa58de tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.153883 May 23 18:15:49.382736 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 513/975] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:49 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:50.399074 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:50.399682 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:50.407153 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:50.407605 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:50.408369 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:50.408809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:50.538651 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:50.546759 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-883c1752-fad8-4d67-b4de-4f841b6903d0 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.151510 May 23 18:15:50.547318 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 463/976] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:50 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:51.563696 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:51.564309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:51.570857 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:51.571305 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:51.572181 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:51.572624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:51.704971 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:51.712275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f4961279-4a99-4021-8e09-bb3b54c0ba1c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.152448 May 23 18:15:51.712964 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 514/977] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:51 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:52.729730 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:52.730363 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:52.736828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:52.737272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:52.738025 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:52.738455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:52.872097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:52.879868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-63792688-fd96-485a-9d26-fe83822a6e40 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.154627 May 23 18:15:52.880491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 464/978] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:52 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:53.896829 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:53.897436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:53.905104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:53.905552 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:53.906310 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:53.906765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:54.064747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:54.072191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4934d52d-32c3-4c65-bf1f-b001cac49077 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.179286 May 23 18:15:54.072900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 515/979] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:53 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:55.089288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:55.089905 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:55.092257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:55.097851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:55.098309 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:55.099141 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:55.099613 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:55.235062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:55.242470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0806f149-3141-4a74-9da1-b48643efe551 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.157192 May 23 18:15:55.243068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 465/980] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:55 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:56.260913 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:56.261530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:56.263591 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:56.264410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:56.271215 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:56.271670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:56.272461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:56.272897 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:56.402255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:56.409786 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1644a33a-2390-4ec5-a931-735732d2227f tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.153264 May 23 18:15:56.410347 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 516/981] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:56 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:57.429082 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:57.429948 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:57.439671 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:57.440114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:57.440886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:57.441321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:57.578204 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:57.585757 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9951af56-38bd-4c45-9e1b-dd54baa1aad6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.162931 May 23 18:15:57.586318 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 466/982] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:57 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:58.602830 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:58.603480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:58.609920 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:58.610363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:58.611138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:58.611570 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:58.742497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:58.750416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3565d3cd-8fc8-4253-b7e7-486bf512a8f8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.151642 May 23 18:15:58.751012 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 517/983] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:58 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:15:59.345988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-6893d4a1-8b09-4f40-b4fd-d0700a030b0a req-3340807f-5796-4e8c-a853-62e978d148ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e", "name": "network-vif-plugged", "status": "completed", "tag": "cdf88afb-8339-4273-a911-bc3379093276"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:15:59.355847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6893d4a1-8b09-4f40-b4fd-d0700a030b0a req-3340807f-5796-4e8c-a853-62e978d148ee service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:59.357383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6893d4a1-8b09-4f40-b4fd-d0700a030b0a req-3340807f-5796-4e8c-a853-62e978d148ee service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:59.369452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-6893d4a1-8b09-4f40-b4fd-d0700a030b0a req-3340807f-5796-4e8c-a853-62e978d148ee service nova] Creating event network-vif-plugged:cdf88afb-8339-4273-a911-bc3379093276 for instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e on hv-cinder-75078 May 23 18:15:59.374559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-6893d4a1-8b09-4f40-b4fd-d0700a030b0a req-3340807f-5796-4e8c-a853-62e978d148ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032303 May 23 18:15:59.375298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 467/984] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:15:59.767879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:15:59.768485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:15:59.775240 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:59.775822 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:59.776583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:15:59.777188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:15:59.910223 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:15:59.918188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-71b56314-9911-415a-a5ab-a6c5f7eb3c6b tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.154152 May 23 18:15:59.918763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 518/985] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:15:59 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:00.989606 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:00.990304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:00.997550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:00.998004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:00.998814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:00.999252 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:01.129812 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:01.137649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-33f73c83-a705-48eb-806b-b5b8cb6ea713 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1266 microversion: 2.1 time: 0.152656 May 23 18:16:01.138223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 468/986] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:00 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:02.154645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:02.155370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:02.162009 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:02.162460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:02.163254 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:02.163695 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:02.294728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:02.302233 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b3ed870-0514-4e5f-8b96-2e5efc607559 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1453 microversion: 2.1 time: 0.151495 May 23 18:16:02.302813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 519/987] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:02 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:02.318949 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:02.319559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:02.326019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:02.326463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:02.327252 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:02.327687 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:02.461763 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:02.469926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1ddf7c40-a5bd-49ca-946c-533565881f54 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1453 microversion: 2.1 time: 0.154886 May 23 18:16:02.470484 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 469/988] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:02 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:04.051427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-13be4405-759b-4715-add1-dc72569dae53 req-d3cee467-2dc5-4d40-8346-cb68bde1baa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e", "tag": "cdf88afb-8339-4273-a911-bc3379093276"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:04.060264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-13be4405-759b-4715-add1-dc72569dae53 req-d3cee467-2dc5-4d40-8346-cb68bde1baa1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:04.060706 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-13be4405-759b-4715-add1-dc72569dae53 req-d3cee467-2dc5-4d40-8346-cb68bde1baa1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:04.073081 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-13be4405-759b-4715-add1-dc72569dae53 req-d3cee467-2dc5-4d40-8346-cb68bde1baa1 service nova] Creating event network-changed:cdf88afb-8339-4273-a911-bc3379093276 for instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e on hv-cinder-75078 May 23 18:16:04.078302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-13be4405-759b-4715-add1-dc72569dae53 req-d3cee467-2dc5-4d40-8346-cb68bde1baa1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030541 May 23 18:16:04.079008 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 520/989] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:16:09.535046 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1467906619"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:09.535594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:09.542427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:09.542918 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:09.543688 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:09.544131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:09.682487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.network.security_group_api [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Removing security group a050e2ce-c4b5-464c-8563-a088791fa62b from port c97baa91-db27-4da5-963a-92d5ba833cb0 May 23 18:16:10.063112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a957f416-e002-41df-af1d-b40fd31bde34 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/action" status: 202 len: 0 microversion: 2.1 time: 0.630266 May 23 18:16:10.064310 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 470/990] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:16:09 2022] POST /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:16:10.080689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-6a515054-3405-419b-8cc8-191a182eb860 req-b5da63a8-8aee-4ac7-8e95-fecbd6d4e32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c5bdee-1834-416c-a8e0-64858b483964", "tag": "c97baa91-db27-4da5-963a-92d5ba833cb0"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:10.091985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6a515054-3405-419b-8cc8-191a182eb860 req-b5da63a8-8aee-4ac7-8e95-fecbd6d4e32c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:10.092558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6a515054-3405-419b-8cc8-191a182eb860 req-b5da63a8-8aee-4ac7-8e95-fecbd6d4e32c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:10.106401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-6a515054-3405-419b-8cc8-191a182eb860 req-b5da63a8-8aee-4ac7-8e95-fecbd6d4e32c service nova] Creating event network-changed:c97baa91-db27-4da5-963a-92d5ba833cb0 for instance 62c5bdee-1834-416c-a8e0-64858b483964 on hv-cinder-75078 May 23 18:16:10.112447 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-6a515054-3405-419b-8cc8-191a182eb860 req-b5da63a8-8aee-4ac7-8e95-fecbd6d4e32c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041622 May 23 18:16:10.113344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 521/991] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:11.483920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:11.484437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:11.486338 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=31 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:11.492019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:11.492471 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:11.493534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:11.494041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:11.499077 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=69 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:11.582327 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lazy-loading 'services' on Instance uuid 62c5bdee-1834-416c-a8e0-64858b483964 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:16:11.659963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df9e17e4-70b6-41c2-8acf-82aa648ee255 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments/4b8d4952-56c9-418d-a641-22de9be838b4" status: 202 len: 0 microversion: 2.1 time: 0.180380 May 23 18:16:11.660702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 471/992] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:16:11 2022] DELETE /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments/4b8d4952-56c9-418d-a641-22de9be838b4 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 18:16:11.670583 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6f262eba-a6d3-4512-8771-468241ed0186 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:11.672279 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6f262eba-a6d3-4512-8771-468241ed0186 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:11.674210 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:11.679998 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f262eba-a6d3-4512-8771-468241ed0186 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:11.680381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f262eba-a6d3-4512-8771-468241ed0186 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:11.681138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f262eba-a6d3-4512-8771-468241ed0186 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:11.681593 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f262eba-a6d3-4512-8771-468241ed0186 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:11.684588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:11.725101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6f262eba-a6d3-4512-8771-468241ed0186 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059866 May 23 18:16:11.725663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 522/993] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:16:11 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:16:12.128238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-534bebdc-2753-43c7-96be-feb725429d3a req-ad0fcb25-3a74-403f-a2fd-71fc43e12bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c5bdee-1834-416c-a8e0-64858b483964", "tag": "c97baa91-db27-4da5-963a-92d5ba833cb0"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:12.137097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-534bebdc-2753-43c7-96be-feb725429d3a req-ad0fcb25-3a74-403f-a2fd-71fc43e12bd8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:12.137627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-534bebdc-2753-43c7-96be-feb725429d3a req-ad0fcb25-3a74-403f-a2fd-71fc43e12bd8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:12.148562 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-534bebdc-2753-43c7-96be-feb725429d3a req-ad0fcb25-3a74-403f-a2fd-71fc43e12bd8 service nova] Creating event network-changed:c97baa91-db27-4da5-963a-92d5ba833cb0 for instance 62c5bdee-1834-416c-a8e0-64858b483964 on hv-cinder-75078 May 23 18:16:12.154456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-534bebdc-2753-43c7-96be-feb725429d3a req-ad0fcb25-3a74-403f-a2fd-71fc43e12bd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030482 May 23 18:16:12.155088 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 472/994] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:12.737126 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d01e056e-5896-4257-a480-2e97b54da78e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:12.738145 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d01e056e-5896-4257-a480-2e97b54da78e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:12.744781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d01e056e-5896-4257-a480-2e97b54da78e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:12.745250 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d01e056e-5896-4257-a480-2e97b54da78e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:12.746031 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d01e056e-5896-4257-a480-2e97b54da78e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:12.746467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d01e056e-5896-4257-a480-2e97b54da78e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:12.776377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d01e056e-5896-4257-a480-2e97b54da78e tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043181 May 23 18:16:12.776935 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 523/995] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:16:12 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:16:12.787780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:12.788362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:12.794594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:12.795017 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:12.795775 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:12.796211 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:12.873294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] HTTP exception thrown: Instance 62c5bdee-1834-416c-a8e0-64858b483964 is not attached to volume 4b8d4952-56c9-418d-a641-22de9be838b4 May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Request method failure captured: May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments/4b8d4952-56c9-418d-a641-22de9be838b4 HTTP/1.1 May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii84QD6OU1rBm-E_DdtU5v0XRmOjnHi4a2J9CN6TzoJE0P52FZGv030Hzkdc5E7wcsqyR38H6RjhEtxz-dgpifD_D2G0Rhp9Xrmtq7BjkEck0j5fnYlQ2zoWNVsES80h0b19k2jPogKH4nl18CRC7FDrjOswjlxRKl_z5KZDlD_ISrtA May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: f7e38224b6a74df8b5e931ccda46d3fd May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-TestMinimumBasicScenario-753380 May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:16:12.896038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-TestMinimumBasicScenario-753380 May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: f7e38224b6a74df8b5e931ccda46d3fd May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-TestMinimumBasicScenario-753380 May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-TestMinimumBasicScenario-753380-project May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: b04754683c9d4f9492f474fa30bea1c2 May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-TestMinimumBasicScenario-753380-project May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:16:12.897621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 62c5bdee-1834-416c-a8e0-64858b483964 is not attached to volume 4b8d4952-56c9-418d-a641-22de9be838b4 May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '62c5bdee-1834-416c-a8e0-64858b483964', 'id': '4b8d4952-56c9-418d-a641-22de9be838b4'} May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4b8d4952-56c9-418d-a641-22de9be838b4. May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:12.898532 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62c5bdee-1834-416c-a8e0-64858b483964 is not attached to volume 4b8d4952-56c9-418d-a641-22de9be838b4 May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62c5bdee-1834-416c-a8e0-64858b483964 is not attached to volume 4b8d4952-56c9-418d-a641-22de9be838b4 May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:12.900632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Returning 404 to user: Instance 62c5bdee-1834-416c-a8e0-64858b483964 is not attached to volume 4b8d4952-56c9-418d-a641-22de9be838b4 {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:12.901555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-12a85a29-c4a2-475e-9683-ded419819c02 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments/4b8d4952-56c9-418d-a641-22de9be838b4" status: 404 len: 154 microversion: 2.1 time: 0.114689 May 23 18:16:12.901555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 473/996] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:16:12 2022] DELETE /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964/os-volume_attachments/4b8d4952-56c9-418d-a641-22de9be838b4 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:13.587370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5ed36a9-1b19-40bc-b49d-c7703f3f41c0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:13.588302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5ed36a9-1b19-40bc-b49d-c7703f3f41c0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:13.594309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5ed36a9-1b19-40bc-b49d-c7703f3f41c0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:13.594790 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5ed36a9-1b19-40bc-b49d-c7703f3f41c0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:13.595550 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5ed36a9-1b19-40bc-b49d-c7703f3f41c0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:13.595984 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5ed36a9-1b19-40bc-b49d-c7703f3f41c0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:13.625143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5ed36a9-1b19-40bc-b49d-c7703f3f41c0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041816 May 23 18:16:13.625691 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 524/997] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:16:13 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:16:13.683008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:13.683507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:13.689374 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:13.689840 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:13.690611 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:13.691071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:13.715947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:16:13.788608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3585ed2c-e8b8-4d3b-8f3c-846f6a945873 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 204 len: 0 microversion: 2.1 time: 0.109226 May 23 18:16:13.793217 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 474/998] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:16:13 2022] DELETE /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:16:13.798987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:13.799611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:13.807475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:13.807909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:13.808742 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:13.809207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:13.937043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:13.944474 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cd1c5ff1-a23a-47b8-bd78-598ee27a8658 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1670 microversion: 2.1 time: 0.149794 May 23 18:16:13.945038 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 525/999] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:13 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:14.031320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:14.031898 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:14.037753 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:14.038194 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:14.038976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:14.039412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:14.064288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:16:14.140634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-72b83a53-838b-436a-9221-daad32dddb3c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 204 len: 0 microversion: 2.1 time: 0.113205 May 23 18:16:14.141221 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 475/1000] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:16:14 2022] DELETE /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:16:14.150387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:14.151096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:14.157185 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:14.157638 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:14.158400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:14.158867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:14.289453 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:14.297037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9eb00a74-6b60-4d1e-9269-3338b0c054d1 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1555 microversion: 2.1 time: 0.151485 May 23 18:16:14.297599 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 526/1001] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:14 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:14.962319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:14.963163 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:14.969587 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:14.970036 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:14.970855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:14.971296 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:15.103485 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:15.111038 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93a6a745-ebda-43a5-b5c9-adb21cbb48c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1670 microversion: 2.1 time: 0.153024 May 23 18:16:15.111600 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 476/1002] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:14 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:15.314652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:15.315277 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:15.322358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:15.322833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:15.323588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:15.324020 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:15.454113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:15.462084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6b1b6a40-a6bf-41da-b7f6-67891da3f397 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1555 microversion: 2.1 time: 0.150829 May 23 18:16:15.462642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 527/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:15 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:16.129632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:16.130244 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:16.138595 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:16.139085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:16.139860 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:16.140303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:16.268330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:16.275832 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-86052ca7-a61e-43e3-a79b-82827551f1c5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1670 microversion: 2.1 time: 0.150338 May 23 18:16:16.276395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 477/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:16 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:16.479751 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:16.480383 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:16.486839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:16.487881 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:16.488659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:16.489104 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:16.723122 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:16.731621 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1703410b-9ace-4d2e-a99e-0ac89d811cb5 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1555 microversion: 2.1 time: 0.256287 May 23 18:16:16.732196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 528/1005] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:16 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:17.229585 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-1ff811da-68d5-4950-8d60-ff21e89ca043 req-1f12b6eb-9582-4c61-b6e3-906e18b6d7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03538a0b-c9de-4f9a-826d-72679e1fde88", "name": "network-vif-deleted", "tag": "18232278-cf4a-4600-a0ef-598db447288f"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:17.238192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1ff811da-68d5-4950-8d60-ff21e89ca043 req-1f12b6eb-9582-4c61-b6e3-906e18b6d7d7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:17.238740 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1ff811da-68d5-4950-8d60-ff21e89ca043 req-1f12b6eb-9582-4c61-b6e3-906e18b6d7d7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:17.254159 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-1ff811da-68d5-4950-8d60-ff21e89ca043 req-1f12b6eb-9582-4c61-b6e3-906e18b6d7d7 service nova] Creating event network-vif-deleted:18232278-cf4a-4600-a0ef-598db447288f for instance 03538a0b-c9de-4f9a-826d-72679e1fde88 on hv-cinder-75078 May 23 18:16:17.259862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-1ff811da-68d5-4950-8d60-ff21e89ca043 req-1f12b6eb-9582-4c61-b6e3-906e18b6d7d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034104 May 23 18:16:17.260492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 478/1006] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:17.298217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:17.298866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:17.311109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:17.313077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:17.314244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:17.319264 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:16:17.319616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Mon May 23 18:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:16:17.328127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:17.347438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-008e80bc-ad9e-403e-9ebf-b281b4b8edad req-69663d40-babb-4c0c-89ad-3d5a2ee3331a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c5bdee-1834-416c-a8e0-64858b483964", "name": "network-vif-deleted", "tag": "c97baa91-db27-4da5-963a-92d5ba833cb0"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:17.357422 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-008e80bc-ad9e-403e-9ebf-b281b4b8edad req-69663d40-babb-4c0c-89ad-3d5a2ee3331a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:17.358155 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-008e80bc-ad9e-403e-9ebf-b281b4b8edad req-69663d40-babb-4c0c-89ad-3d5a2ee3331a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:17.377552 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-008e80bc-ad9e-403e-9ebf-b281b4b8edad req-69663d40-babb-4c0c-89ad-3d5a2ee3331a service nova] Creating event network-vif-deleted:c97baa91-db27-4da5-963a-92d5ba833cb0 for instance 62c5bdee-1834-416c-a8e0-64858b483964 on hv-cinder-75078 May 23 18:16:17.390089 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-008e80bc-ad9e-403e-9ebf-b281b4b8edad req-69663d40-babb-4c0c-89ad-3d5a2ee3331a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054870 May 23 18:16:17.392119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 479/1007] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:17.423812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:17.438304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a01284cf-5b81-463f-9907-b0a90c4aa7a9 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 200 len: 1321 microversion: 2.1 time: 0.148828 May 23 18:16:17.439256 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 529/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:17 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:17.750086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:17.750911 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:17.758199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:17.759423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:17.760645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:17.761085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:17.793869 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:17.794172 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:17.794638 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lazy-loading 'fault' on Instance uuid 62c5bdee-1834-416c-a8e0-64858b483964 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:16:17.837446 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04754683c9d4f9492f474fa30bea1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e38224b6a74df8b5e931ccda46d3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:17.844873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ee08f7d3-ef78-42d0-82e3-7f4641375034 tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 200 len: 1348 microversion: 2.1 time: 0.099179 May 23 18:16:17.845427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 480/1009] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:17 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:18.456185 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:18.456796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:18.464018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:18.464467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:18.465227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:18.465661 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:18.479743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] HTTP exception thrown: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Request method failure captured: May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 HTTP/1.1 May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii82CyItBTSoroux5ItMu69j4Yv04ataAHIZSxpRW0OOv03LVNWad8u6WDjpHU2yWia17xVjFbn_OrDWsnStrDj3sXhwup_OLNCTvTvizldrsvXcaHEFJwBEh1pVN_la44bWkHPZOqF4DSU1nPa-7jzQcBscZ_UfCEqy5HwV-kHn5Khg May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: e00ef21138204550843697c5f33a8999 May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:16:18.481356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e00ef21138204550843697c5f33a8999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e00ef21138204550843697c5f33a8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeTestJSON-1512431520 May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: e00ef21138204550843697c5f33a8999 May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 8d08ba344a9349d99de16520d3ce5150 May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:16:18.482943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '03538a0b-c9de-4f9a-826d-72679e1fde88'} May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:18.483889 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:16:18.485326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.486823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Returning 404 to user: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:18.486823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30f3d01e-d1d3-4eaa-bede-ba30bc80d282 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 404 len: 111 microversion: 2.1 time: 0.030403 May 23 18:16:18.486823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 530/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:18 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:18.491434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-756bdbc8-20d9-40fc-b293-7a25d94bb84f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '.version_select at 0x7f8c1c1de670>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:18.513152 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-756bdbc8-20d9-40fc-b293-7a25d94bb84f tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792161771" status: 202 len: 0 microversion: 2.1 time: 0.025457 May 23 18:16:18.513724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 481/1011] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 18:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792161771 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:16:18.862371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:18.863001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] [instance: 62c5bdee-1834-416c-a8e0-64858b483964] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:18.868897 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:18.869340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:18.870091 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:18.870520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:18.884252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] HTTP exception thrown: Instance 62c5bdee-1834-416c-a8e0-64858b483964 could not be found. May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Request method failure captured: May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 HTTP/1.1 May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii84QD6OU1rBm-E_DdtU5v0XRmOjnHi4a2J9CN6TzoJE0P52FZGv030Hzkdc5E7wcsqyR38H6RjhEtxz-dgpifD_D2G0Rhp9Xrmtq7BjkEck0j5fnYlQ2zoWNVsES80h0b19k2jPogKH4nl18CRC7FDrjOswjlxRKl_z5KZDlD_ISrtA May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: f7e38224b6a74df8b5e931ccda46d3fd May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-TestMinimumBasicScenario-753380 May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:16:18.886459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7e38224b6a74df8b5e931ccda46d3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-TestMinimumBasicScenario-753380 May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: f7e38224b6a74df8b5e931ccda46d3fd May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-TestMinimumBasicScenario-753380 May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-TestMinimumBasicScenario-753380-project May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: b04754683c9d4f9492f474fa30bea1c2 May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-TestMinimumBasicScenario-753380-project May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 62c5bdee-1834-416c-a8e0-64858b483964 could not be found. May 23 18:16:18.887951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '62c5bdee-1834-416c-a8e0-64858b483964'} May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62c5bdee-1834-416c-a8e0-64858b483964 could not be found. May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:18.888747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62c5bdee-1834-416c-a8e0-64858b483964 could not be found. May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62c5bdee-1834-416c-a8e0-64858b483964 could not be found. May 23 18:16:18.895013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:18.897249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Returning 404 to user: Instance 62c5bdee-1834-416c-a8e0-64858b483964 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:18.897249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9fb9f482-add4-41a0-8325-79ebebc1705c tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964" status: 404 len: 111 microversion: 2.1 time: 0.030038 May 23 18:16:18.897249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 531/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:18 2022] GET /compute/v2.1/servers/62c5bdee-1834-416c-a8e0-64858b483964 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:18.897788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1235f398-9f30-4f44-8103-e33cd91bd9fc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] Calling method '.version_select at 0x7f8c1c038700>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:18.919396 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1235f398-9f30-4f44-8103-e33cd91bd9fc tempest-TestMinimumBasicScenario-753380 tempest-TestMinimumBasicScenario-753380-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1464658032" status: 202 len: 0 microversion: 2.1 time: 0.025669 May 23 18:16:18.919963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 482/1013] 10.222.0.30 () {58 vars in 1271 bytes} [Mon May 23 18:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1464658032 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:16:19.151263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dd6ed682-becd-4d36-a905-79a59946d9d4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'create', calling method: .version_select at 0x7f8c1c11a1f0>, body: {"keypair": {"name": "tempest-keypair-165364544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjQPclERjwfqe+BKXYh9j7EgZJv8frG1u9awPZ+UsIDa/19BEKbPNcV1ZzlY1dS1tL07r9F/4V3mbo581pDjQB5WL58LK0vy0swNnizx4afo0mj5QRuJ1W5QkdNipMshQ=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:19.165504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-dd6ed682-becd-4d36-a905-79a59946d9d4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for project e00ef21138204550843697c5f33a8999. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:16:19.173446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-dd6ed682-becd-4d36-a905-79a59946d9d4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for user 8d08ba344a9349d99de16520d3ce5150 and project e00ef21138204550843697c5f33a8999. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:16:19.201282 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dd6ed682-becd-4d36-a905-79a59946d9d4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054505 May 23 18:16:19.202014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 532/1014] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:16:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:21.522981 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1007128757", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9540f4ea-42f0-45da-912b-c95b248937e6"}], "security_groups": [{"name": "tempest-securitygroup--1653279375"}], "key_name": "tempest-keypair-165364544", "user_data": "}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:21.645749 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] validate_networks() for [('9540f4ea-42f0-45da-912b-c95b248937e6', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:16:22.074310 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:16:22.074756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:16:22.075233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:16:22.075641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:16:22.076053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:16:22.084929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:22.085380 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:22.086180 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:22.086802 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:22.104769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for project e00ef21138204550843697c5f33a8999. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:16:22.109595 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Getting quotas for user 8d08ba344a9349d99de16520d3ce5150 and project e00ef21138204550843697c5f33a8999. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:16:22.121362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:16:22.123692 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:16:22.173644 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4d9398f5-9281-468b-b573-5ea79a7e1af0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.656250 May 23 18:16:22.174288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 483/1015] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:16:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:16:22.185530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a6e4f21-7956-4fb4-bc76-ef919d4d01fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:22.186386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3a6e4f21-7956-4fb4-bc76-ef919d4d01fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:22.290319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3a6e4f21-7956-4fb4-bc76-ef919d4d01fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:22.299756 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3a6e4f21-7956-4fb4-bc76-ef919d4d01fe tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1237 microversion: 2.1 time: 0.118032 May 23 18:16:22.301049 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 533/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:22 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:23.319643 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:23.320403 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:23.329078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:23.329637 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:23.330679 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:23.331294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:23.436296 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:23.447228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a35b9dcf-a60f-46c1-b6f7-e6bc90a434e3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1295 microversion: 2.1 time: 0.133083 May 23 18:16:23.450524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 484/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:23 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1295 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:24.466999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:24.467525 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:24.474269 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:24.474780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:24.475515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:24.475950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:24.677253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:24.687261 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-76fdee2a-c912-4886-a284-55383cc02430 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.223633 May 23 18:16:24.688375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 534/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:24 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:24.833054 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-3212cd97-99a9-440e-a478-aa19da527160 req-371617e2-8b22-4b3e-845c-b13976937419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad49721-4ef6-421a-bc3a-da1673c723db", "tag": "8d540380-8b34-4b72-8925-5ba0df6a12d6"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:24.850137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3212cd97-99a9-440e-a478-aa19da527160 req-371617e2-8b22-4b3e-845c-b13976937419 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:24.855594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3212cd97-99a9-440e-a478-aa19da527160 req-371617e2-8b22-4b3e-845c-b13976937419 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:24.882084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-3212cd97-99a9-440e-a478-aa19da527160 req-371617e2-8b22-4b3e-845c-b13976937419 service nova] Creating event network-changed:8d540380-8b34-4b72-8925-5ba0df6a12d6 for instance 8ad49721-4ef6-421a-bc3a-da1673c723db on hv-cinder-75078 May 23 18:16:24.891664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-3212cd97-99a9-440e-a478-aa19da527160 req-371617e2-8b22-4b3e-845c-b13976937419 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061932 May 23 18:16:24.892830 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 485/1019] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:16:25.705288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:25.706530 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:25.713547 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:25.714290 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:25.715179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:25.715679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:25.855580 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:25.863237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-07d07b14-e846-474d-9823-a7cb7adfe9ac tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.161807 May 23 18:16:25.864387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 535/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:25 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:26.881274 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:26.882154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:26.890040 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:26.890491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:26.891295 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:26.891731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:27.089496 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:27.101077 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa87ef73-4aa3-44bc-835a-dc5aab9ea5c3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.224002 May 23 18:16:27.103050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 486/1021] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:26 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:27.996571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:27.997097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:28.006266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:28.006451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:28.007635 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:28.008899 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:28.107647 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lazy-loading 'services' on Instance uuid af994d05-2cb5-4804-ac2c-46d19e2d04b1 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:16:28.120033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:28.121215 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:28.128322 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:28.129500 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:28.130452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:28.131071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:28.250531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a42762b0-13ba-42c8-bbfe-666c4ad8d043 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments/9ce1f8fe-693d-447a-9716-75e346efcb8c" status: 202 len: 0 microversion: 2.1 time: 0.258489 May 23 18:16:28.255162 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 536/1022] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:16:27 2022] DELETE /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments/9ce1f8fe-693d-447a-9716-75e346efcb8c => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:16:28.262319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2c24045b-2f29-42d8-8cde-60625b01fc90 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:28.265271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2c24045b-2f29-42d8-8cde-60625b01fc90 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:28.272774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c24045b-2f29-42d8-8cde-60625b01fc90 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:28.273508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c24045b-2f29-42d8-8cde-60625b01fc90 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:28.274439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c24045b-2f29-42d8-8cde-60625b01fc90 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:28.275442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c24045b-2f29-42d8-8cde-60625b01fc90 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:28.310211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2c24045b-2f29-42d8-8cde-60625b01fc90 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053020 May 23 18:16:28.314159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 537/1023] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:16:28 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:28.347127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:28.355685 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aecf5728-a461-4546-84cb-e7b0d4a5efd7 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.240537 May 23 18:16:28.357014 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 487/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:28 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:16:29.322189 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-58ca0e66-6cdf-4972-b538-89ed3eb09250 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:29.323154 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-58ca0e66-6cdf-4972-b538-89ed3eb09250 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:29.329689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58ca0e66-6cdf-4972-b538-89ed3eb09250 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.330137 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58ca0e66-6cdf-4972-b538-89ed3eb09250 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.330932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58ca0e66-6cdf-4972-b538-89ed3eb09250 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.331368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58ca0e66-6cdf-4972-b538-89ed3eb09250 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.359004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-58ca0e66-6cdf-4972-b538-89ed3eb09250 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041468 May 23 18:16:29.359551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 538/1025] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:16:29 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:16:29.373626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:29.374251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:29.381542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.382246 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.383251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.384373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.445637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:29.446638 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:29.453388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.454077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.455108 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.455879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.482896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:16:29.536457 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:29.538751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:29.544074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:29.546275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-443a7d20-92e9-4897-96ee-2cd9b768a751 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.177326 May 23 18:16:29.547035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 488/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:29 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:29.580362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3e22eba-08b2-4da2-88ab-319d8fbf9ad2 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 204 len: 0 microversion: 2.1 time: 0.139213 May 23 18:16:29.580933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 539/1027] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:16:29 2022] DELETE /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:16:29.589915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:29.590524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:29.597229 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.597677 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.598438 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:29.598914 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:29.729296 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:29.736642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-98e13edc-9d96-4355-878c-0c6e79c8ba9f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1688 microversion: 2.1 time: 0.151709 May 23 18:16:29.737199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 489/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:29 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:30.564749 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:30.565483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:30.572511 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:30.572961 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:30.573721 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:30.574156 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:30.703009 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:30.710382 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8d35e41f-7b4e-41b5-96cb-588895c3a6f2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.149875 May 23 18:16:30.710988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 540/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:30 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:30.754185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:30.754817 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:30.762500 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:30.762972 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:30.763729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:30.764158 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:30.895612 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:30.903299 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6cd8ec74-3ac7-47bc-8753-dbc989bbb515 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1688 microversion: 2.1 time: 0.153205 May 23 18:16:30.903865 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 490/1030] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:30 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:31.558161 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-7b57b6a5-ed27-439d-838e-7915fc676ff3 req-2bb09788-8020-4012-afb0-d88ebb43b92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad49721-4ef6-421a-bc3a-da1673c723db", "name": "network-vif-plugged", "status": "completed", "tag": "8d540380-8b34-4b72-8925-5ba0df6a12d6"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:31.566432 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-7b57b6a5-ed27-439d-838e-7915fc676ff3 req-2bb09788-8020-4012-afb0-d88ebb43b92f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:31.567039 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-7b57b6a5-ed27-439d-838e-7915fc676ff3 req-2bb09788-8020-4012-afb0-d88ebb43b92f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:31.578495 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-7b57b6a5-ed27-439d-838e-7915fc676ff3 req-2bb09788-8020-4012-afb0-d88ebb43b92f service nova] Creating event network-vif-plugged:8d540380-8b34-4b72-8925-5ba0df6a12d6 for instance 8ad49721-4ef6-421a-bc3a-da1673c723db on hv-cinder-75078 May 23 18:16:31.583221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-7b57b6a5-ed27-439d-838e-7915fc676ff3 req-2bb09788-8020-4012-afb0-d88ebb43b92f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029116 May 23 18:16:31.583823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 541/1031] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:31.728102 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:31.728631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:31.734680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:31.735162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:31.735931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:31.736373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:31.871997 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:31.880262 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-de2153d9-3d08-426b-b167-353973160e82 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.156601 May 23 18:16:31.880825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 491/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:31 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:31.920239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:31.920940 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:31.927411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:31.927874 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:31.928641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:31.929078 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:32.064893 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:32.073493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7bead4ea-d87b-4597-9fec-aa7029bcd76f tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1688 microversion: 2.1 time: 0.157457 May 23 18:16:32.074066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 542/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:31 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:32.897936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:32.898574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:32.901270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:32.901925 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:32.907755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:32.908183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:32.908973 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:32.909408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:33.048518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:33.056091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-be19652b-d44d-4b98-945c-772c7d111b62 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1363 microversion: 2.1 time: 0.162586 May 23 18:16:33.056651 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 492/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:32 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:33.089974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:33.090588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:33.092637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:33.098795 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:33.099250 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:33.100008 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:33.100465 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:33.175710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:33.183131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-97250c8a-b6cd-46c5-a1e3-2a536d876739 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 200 len: 1620 microversion: 2.1 time: 0.097749 May 23 18:16:33.183707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 543/1035] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:33 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 1620 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:33.282407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-e6362f75-ad9e-4fe2-a268-e9a53262e335 req-4c2186a4-e3aa-4434-9e51-46c706eefad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af994d05-2cb5-4804-ac2c-46d19e2d04b1", "name": "network-vif-deleted", "tag": "3e5629ff-ce51-43da-9392-add0febcff5b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:33.290622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e6362f75-ad9e-4fe2-a268-e9a53262e335 req-4c2186a4-e3aa-4434-9e51-46c706eefad1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:33.291097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e6362f75-ad9e-4fe2-a268-e9a53262e335 req-4c2186a4-e3aa-4434-9e51-46c706eefad1 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:33.302433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-e6362f75-ad9e-4fe2-a268-e9a53262e335 req-4c2186a4-e3aa-4434-9e51-46c706eefad1 service nova] Creating event network-vif-deleted:3e5629ff-ce51-43da-9392-add0febcff5b for instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 on hv-cinder-75078 May 23 18:16:33.307915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-e6362f75-ad9e-4fe2-a268-e9a53262e335 req-4c2186a4-e3aa-4434-9e51-46c706eefad1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029320 May 23 18:16:33.311521 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 493/1036] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:34.074318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:34.074965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:34.081219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:34.081664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:34.082429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:34.082886 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:34.201236 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:34.202688 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: af994d05-2cb5-4804-ac2c-46d19e2d04b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:34.209300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:34.209974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:34.210993 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:34.211618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:34.228057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] HTTP exception thrown: Instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 could not be found. May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Request method failure captured: May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 HTTP/1.1 May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii8127MkRXqbu9k9Nm02gGmw0dbE0r3UiP2ANN9q4-I1aSilsO_JAozGVgDSK_GRtdLX48pvQNSule4mkoeLNDfo3CowdogXzk6uDwy9pnvn6S_1Gz7-vtCHYsfELPbfQXjf7xtXXMjvgHMvcUQJVbxxdVUL7YIYcwbkXwZo2e8yNT2s May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:16:34.230053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: a57822c1558143d38ad17326a742c370 May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 could not be found. May 23 18:16:34.231554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'af994d05-2cb5-4804-ac2c-46d19e2d04b1'} May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 could not be found. May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:34.232319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 could not be found. May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 could not be found. May 23 18:16:34.233561 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:34.236075 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Returning 404 to user: Instance af994d05-2cb5-4804-ac2c-46d19e2d04b1 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:34.237521 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c2d3f4e-7428-4a79-8211-56949fc44c17 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1" status: 404 len: 111 microversion: 2.1 time: 0.040969 May 23 18:16:34.238613 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 494/1037] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:34 2022] GET /compute/v2.1/servers/af994d05-2cb5-4804-ac2c-46d19e2d04b1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:34.249086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-542f52bf-05cb-4d4f-8101-ec48ba210a5b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '.version_select at 0x7f8c16faba60>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:34.260622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:34.269023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b73b521b-c8a0-47df-96ce-bc95391e4fe3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1548 microversion: 2.1 time: 0.199861 May 23 18:16:34.280318 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-542f52bf-05cb-4d4f-8101-ec48ba210a5b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205514635" status: 202 len: 0 microversion: 2.1 time: 0.027580 May 23 18:16:34.280318 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 495/1038] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 18:16:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205514635 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:16:34.280950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 544/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:34 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:34.286443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e209b48d-789e-40c7-9782-6e2404357950 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:34.286964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e209b48d-789e-40c7-9782-6e2404357950 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:34.294294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e209b48d-789e-40c7-9782-6e2404357950 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:34.294799 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e209b48d-789e-40c7-9782-6e2404357950 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:34.295564 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e209b48d-789e-40c7-9782-6e2404357950 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:34.296012 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e209b48d-789e-40c7-9782-6e2404357950 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:34.402194 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e209b48d-789e-40c7-9782-6e2404357950 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119846 May 23 18:16:34.403126 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 496/1040] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:16:34 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:35.348298 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-f7683284-2e86-4858-becc-ba8ba0ef0759 req-3c629403-e9e1-434e-90ea-89a8f1a9df29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad49721-4ef6-421a-bc3a-da1673c723db", "tag": "8d540380-8b34-4b72-8925-5ba0df6a12d6"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:35.357763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f7683284-2e86-4858-becc-ba8ba0ef0759 req-3c629403-e9e1-434e-90ea-89a8f1a9df29 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:35.358208 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f7683284-2e86-4858-becc-ba8ba0ef0759 req-3c629403-e9e1-434e-90ea-89a8f1a9df29 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:35.369447 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-f7683284-2e86-4858-becc-ba8ba0ef0759 req-3c629403-e9e1-434e-90ea-89a8f1a9df29 service nova] Creating event network-changed:8d540380-8b34-4b72-8925-5ba0df6a12d6 for instance 8ad49721-4ef6-421a-bc3a-da1673c723db on hv-cinder-75078 May 23 18:16:35.374460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-f7683284-2e86-4858-becc-ba8ba0ef0759 req-3c629403-e9e1-434e-90ea-89a8f1a9df29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029735 May 23 18:16:35.374909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 545/1041] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:37.429170 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:37.429674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:37.435713 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:37.436168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:37.436931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:37.437370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:37.461352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:16:37.537595 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-58548fe9-ed1a-436b-8664-8cde7d147d8d tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 204 len: 0 microversion: 2.1 time: 0.112345 May 23 18:16:37.538320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 497/1042] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:16:37 2022] DELETE /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:16:37.548123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:37.548811 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:37.554964 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:37.555416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:37.556159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:37.556587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:37.684603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:37.692132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-84623523-a87d-453c-abab-b167ced4ecbe tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1509 microversion: 2.1 time: 0.148690 May 23 18:16:37.692694 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 546/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:37 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:38.710070 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:38.710903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:38.717421 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:38.718007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:38.718930 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:38.719477 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:38.793809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:38.798288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-00cfefd7-f95b-422c-ab79-ac54636f6051 req-5f49baac-29af-4fc9-be75-49c7d82d847f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7f7689-8026-4116-b605-567d3ad605b1", "name": "network-vif-deleted", "tag": "24192180-2c11-45fa-bcc6-613fdc478a7a"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:38.802091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f4e970d3-e2d2-4440-be25-b243180ef1aa tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 200 len: 1467 microversion: 2.1 time: 0.096370 May 23 18:16:38.802796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 498/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:38 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 1467 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:38.816612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-00cfefd7-f95b-422c-ab79-ac54636f6051 req-5f49baac-29af-4fc9-be75-49c7d82d847f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:38.817052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-00cfefd7-f95b-422c-ab79-ac54636f6051 req-5f49baac-29af-4fc9-be75-49c7d82d847f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:38.828652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-00cfefd7-f95b-422c-ab79-ac54636f6051 req-5f49baac-29af-4fc9-be75-49c7d82d847f service nova] Creating event network-vif-deleted:24192180-2c11-45fa-bcc6-613fdc478a7a for instance 7a7f7689-8026-4116-b605-567d3ad605b1 on hv-cinder-75078 May 23 18:16:38.833626 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-00cfefd7-f95b-422c-ab79-ac54636f6051 req-5f49baac-29af-4fc9-be75-49c7d82d847f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039277 May 23 18:16:38.834397 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 547/1045] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:39.822173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:39.822827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: 7a7f7689-8026-4116-b605-567d3ad605b1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:39.829525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:39.829977 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:39.830770 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:39.831221 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:39.844845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] HTTP exception thrown: Instance 7a7f7689-8026-4116-b605-567d3ad605b1 could not be found. May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Request method failure captured: May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 HTTP/1.1 May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii8127MkRXqbu9k9Nm02gGmw0dbE0r3UiP2ANN9q4-I1aSilsO_JAozGVgDSK_GRtdLX48pvQNSule4mkoeLNDfo3CowdogXzk6uDwy9pnvn6S_1Gz7-vtCHYsfELPbfQXjf7xtXXMjvgHMvcUQJVbxxdVUL7YIYcwbkXwZo2e8yNT2s May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:16:39.846518 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: a57822c1558143d38ad17326a742c370 May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 7a7f7689-8026-4116-b605-567d3ad605b1 could not be found. May 23 18:16:39.848171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '7a7f7689-8026-4116-b605-567d3ad605b1'} May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7f7689-8026-4116-b605-567d3ad605b1 could not be found. May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:39.849306 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7f7689-8026-4116-b605-567d3ad605b1 could not be found. May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7f7689-8026-4116-b605-567d3ad605b1 could not be found. May 23 18:16:39.850843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:39.852405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Returning 404 to user: Instance 7a7f7689-8026-4116-b605-567d3ad605b1 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:39.852405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8b7459e-7b0d-4f08-9d75-0dadabb3c32b tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1" status: 404 len: 111 microversion: 2.1 time: 0.030812 May 23 18:16:39.852405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 499/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:39 2022] GET /compute/v2.1/servers/7a7f7689-8026-4116-b605-567d3ad605b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:39.857594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:39.858179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:39.864567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:39.865021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:39.865821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:39.866321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:39.892860 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:16:39.968127 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-635a0ae2-61c2-4ac7-a90a-cf61ad9bf5d3 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 204 len: 0 microversion: 2.1 time: 0.114862 May 23 18:16:39.968996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 548/1047] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:16:39 2022] DELETE /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:16:39.977944 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:39.978627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:39.980570 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:39.986691 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:39.987169 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:39.987937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:39.988377 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:40.123678 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:40.131370 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2f935318-57af-4fbe-8a25-687801d89fcb tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1523 microversion: 2.1 time: 0.157860 May 23 18:16:40.131937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 500/1048] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:39 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:41.148798 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:41.149551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:41.156065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:41.156509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:41.157272 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:41.157706 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:41.257318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57822c1558143d38ad17326a742c370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d48ee3a0df47dab968b0b92443648c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:41.266133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-60a43ee2-93fe-46e2-9821-2b09b7d24b02 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 200 len: 1481 microversion: 2.1 time: 0.121521 May 23 18:16:41.275910 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 549/1049] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:41 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 1481 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:16:41.293048 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-ced9634f-0965-4c37-9081-c9a766fcd0b3 req-8856f962-ee51-4772-a4a1-cef21c1995cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb843a05-dbd1-4fbf-94a9-1dff354593f0", "name": "network-vif-deleted", "tag": "b9cadce7-4d82-436c-82ae-68af5f3a712a"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:41.303174 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-ced9634f-0965-4c37-9081-c9a766fcd0b3 req-8856f962-ee51-4772-a4a1-cef21c1995cd service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:41.303621 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-ced9634f-0965-4c37-9081-c9a766fcd0b3 req-8856f962-ee51-4772-a4a1-cef21c1995cd service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:41.315796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-ced9634f-0965-4c37-9081-c9a766fcd0b3 req-8856f962-ee51-4772-a4a1-cef21c1995cd service nova] Creating event network-vif-deleted:b9cadce7-4d82-436c-82ae-68af5f3a712a for instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 on hv-cinder-75078 May 23 18:16:41.321853 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-ced9634f-0965-4c37-9081-c9a766fcd0b3 req-8856f962-ee51-4772-a4a1-cef21c1995cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032206 May 23 18:16:41.324202 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 501/1050] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:16:42.283387 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:42.284022 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] [instance: fb843a05-dbd1-4fbf-94a9-1dff354593f0] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:42.286505 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:42.292183 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:42.292689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:42.293384 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:42.293811 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:42.308608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] HTTP exception thrown: Instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 could not be found. May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Request method failure captured: May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 HTTP/1.1 May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii8127MkRXqbu9k9Nm02gGmw0dbE0r3UiP2ANN9q4-I1aSilsO_JAozGVgDSK_GRtdLX48pvQNSule4mkoeLNDfo3CowdogXzk6uDwy9pnvn6S_1Gz7-vtCHYsfELPbfQXjf7xtXXMjvgHMvcUQJVbxxdVUL7YIYcwbkXwZo2e8yNT2s May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:16:42.310217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74d48ee3a0df47dab968b0b92443648c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 74d48ee3a0df47dab968b0b92443648c May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056202678 May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: a57822c1558143d38ad17326a742c370 May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056202678-project May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 could not be found. May 23 18:16:42.311877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'fb843a05-dbd1-4fbf-94a9-1dff354593f0'} May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 could not be found. May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:42.312918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 could not be found. May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 could not be found. May 23 18:16:42.314366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:42.315799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] Returning 404 to user: Instance fb843a05-dbd1-4fbf-94a9-1dff354593f0 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:42.315799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a997fe56-dd7e-4335-b68b-5f4f3d921a42 tempest-ServerRescueNegativeTestJSON-1056202678 tempest-ServerRescueNegativeTestJSON-1056202678-project] 10.222.0.30 "GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0" status: 404 len: 111 microversion: 2.1 time: 0.032121 May 23 18:16:42.315799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 550/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:16:42 2022] GET /compute/v2.1/servers/fb843a05-dbd1-4fbf-94a9-1dff354593f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:46.737503 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21770b78-3bf7-4c5c-ad44-f82002f92af3 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Action: 'create', calling method: .version_select at 0x7f8c1c3b4040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-832739939", "metadata": {"Type": "work"}}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21770b78-3bf7-4c5c-ad44-f82002f92af3 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Request method failure captured: May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 121 May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii8-OWFnDL-2yqICX-m11dGd1ycYvA7so7TX-JPpNzzlwrmFovlsyVxSSCxwLlezV880AptbqU8mGeiBFruvRvpW2XeIVdn1SjxpcUdHVyFI7Dmp7wAb1_JZrBgwcls7u1SgUwkI0VWECitMKvXbmqZMSFGwR4dpDHm-NQwo4Fe10ug8 May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:16:46.758214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: b2f00979211947b1b8e04b69c0fbba78 May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-832739939", "metadata": {"Type": "work"}}} May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: May 23 18:16:46.760308 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-832739939', 'metadata': {'Type': 'work'}}}} May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise error May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi '#$%' May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:46.761168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 18:16:46.762554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 18:16:46.763783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 18:16:46.763783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.763783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21770b78-3bf7-4c5c-ad44-f82002f92af3 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:46.763783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21770b78-3bf7-4c5c-ad44-f82002f92af3 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139163 May 23 18:16:46.763783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 502/1052] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 18:16:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 18:16:46.770002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b546252-406f-48a2-957d-b2ad7f9804f6 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Action: 'create', calling method: .version_select at 0x7f8c1c1cc5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-171210892", "metadata": {"Type": "work"}}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b546252-406f-48a2-957d-b2ad7f9804f6 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Request method failure captured: May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 119 May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii8-OWFnDL-2yqICX-m11dGd1ycYvA7so7TX-JPpNzzlwrmFovlsyVxSSCxwLlezV880AptbqU8mGeiBFruvRvpW2XeIVdn1SjxpcUdHVyFI7Dmp7wAb1_JZrBgwcls7u1SgUwkI0VWECitMKvXbmqZMSFGwR4dpDHm-NQwo4Fe10ug8 May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:16:46.773197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: b2f00979211947b1b8e04b69c0fbba78 May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-171210892", "metadata": {"Type": "work"}}} May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: May 23 18:16:46.775249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-171210892', 'metadata': {'Type': 'work'}}}} May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise error May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi '0' May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:46.776295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 18:16:46.777717 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 18:16:46.778878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 18:16:46.778878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.778878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b546252-406f-48a2-957d-b2ad7f9804f6 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:46.778878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b546252-406f-48a2-957d-b2ad7f9804f6 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008523 May 23 18:16:46.778878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 551/1053] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 18:16:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 18:16:46.785084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ffe3cfe0-3d62-48e8-9b14-b3c6a8e07fb4 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Action: 'create', calling method: .version_select at 0x7f8c1c3e4790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1594354828", "metadata": {"Type": "work"}}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ffe3cfe0-3d62-48e8-9b14-b3c6a8e07fb4 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Request method failure captured: May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 119 May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii8-OWFnDL-2yqICX-m11dGd1ycYvA7so7TX-JPpNzzlwrmFovlsyVxSSCxwLlezV880AptbqU8mGeiBFruvRvpW2XeIVdn1SjxpcUdHVyFI7Dmp7wAb1_JZrBgwcls7u1SgUwkI0VWECitMKvXbmqZMSFGwR4dpDHm-NQwo4Fe10ug8 May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:16:46.788005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: b2f00979211947b1b8e04b69c0fbba78 May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1594354828", "metadata": {"Type": "work"}}} May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: May 23 18:16:46.789594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1594354828', 'metadata': {'Type': 'work'}}}} May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise error May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi '' May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:46.790785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 18:16:46.792540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 18:16:46.793897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 18:16:46.793897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.793897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ffe3cfe0-3d62-48e8-9b14-b3c6a8e07fb4 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:46.793897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ffe3cfe0-3d62-48e8-9b14-b3c6a8e07fb4 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008806 May 23 18:16:46.793897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 503/1054] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 18:16:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 18:16:46.799897 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b367aa66-595d-4ce9-b395-4893b065eb2c tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Calling method '.version_select at 0x7f8c1c121940>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:46.835199 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-b367aa66-595d-4ce9-b395-4893b065eb2c tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] HTTP exception thrown: Volume tempest-invalid-1671868939 could not be found. May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b367aa66-595d-4ce9-b395-4893b065eb2c tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Request method failure captured: May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1671868939 HTTP/1.1 May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii8-OWFnDL-2yqICX-m11dGd1ycYvA7so7TX-JPpNzzlwrmFovlsyVxSSCxwLlezV880AptbqU8mGeiBFruvRvpW2XeIVdn1SjxpcUdHVyFI7Dmp7wAb1_JZrBgwcls7u1SgUwkI0VWECitMKvXbmqZMSFGwR4dpDHm-NQwo4Fe10ug8 May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:16:46.837780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: b2f00979211947b1b8e04b69c0fbba78 May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Volume tempest-invalid-1671868939 could not be found. May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'tempest-invalid-1671868939'} May 23 18:16:46.839377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1671868939 could not be found. (HTTP 404) (Request-ID: req-66418c85-1338-4219-9db0-28cb652378a7) May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.840340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 18:16:46.841522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1671868939 could not be found. May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:46.842741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1671868939 could not be found. May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1671868939 could not be found. May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b367aa66-595d-4ce9-b395-4893b065eb2c tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Returning 404 to user: Volume tempest-invalid-1671868939 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b367aa66-595d-4ce9-b395-4893b065eb2c tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1671868939" status: 404 len: 99 microversion: 2.1 time: 0.043801 May 23 18:16:46.843936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 552/1055] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 18:16:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1671868939 => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 18:16:46.849988 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-83095aea-3e7a-4eae-86cc-8e3edcb06d2e tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005034 May 23 18:16:46.850486 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 504/1056] 10.222.0.30 () {58 vars in 1139 bytes} [Mon May 23 18:16:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 18:16:46.858966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-98ae9603-0825-402f-8a3d-7ff42d0f79ab tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003723 May 23 18:16:46.859461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 553/1057] 10.222.0.30 () {58 vars in 1136 bytes} [Mon May 23 18:16:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 18:16:46.867719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-422f4f5f-9c46-4fd4-9207-d5a18121c7c2 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Calling method '.version_select at 0x7f8c1c1e0af0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:46.896610 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-422f4f5f-9c46-4fd4-9207-d5a18121c7c2 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] HTTP exception thrown: Volume 7175ec56-fc4c-413f-b8e4-914916ef7eac could not be found. May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-422f4f5f-9c46-4fd4-9207-d5a18121c7c2 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Request method failure captured: May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/os-volumes/7175ec56-fc4c-413f-b8e4-914916ef7eac HTTP/1.1 May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii8-OWFnDL-2yqICX-m11dGd1ycYvA7so7TX-JPpNzzlwrmFovlsyVxSSCxwLlezV880AptbqU8mGeiBFruvRvpW2XeIVdn1SjxpcUdHVyFI7Dmp7wAb1_JZrBgwcls7u1SgUwkI0VWECitMKvXbmqZMSFGwR4dpDHm-NQwo4Fe10ug8 May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:16:46.898517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: b2f00979211947b1b8e04b69c0fbba78 May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Volume 7175ec56-fc4c-413f-b8e4-914916ef7eac could not be found. May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '7175ec56-fc4c-413f-b8e4-914916ef7eac'} May 23 18:16:46.900779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7175ec56-fc4c-413f-b8e4-914916ef7eac could not be found. (HTTP 404) (Request-ID: req-460099bf-7e31-40bf-a15c-a6d8c949d416) May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.902663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 18:16:46.904491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7175ec56-fc4c-413f-b8e4-914916ef7eac could not be found. May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 18:16:46.905816 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7175ec56-fc4c-413f-b8e4-914916ef7eac could not be found. May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7175ec56-fc4c-413f-b8e4-914916ef7eac could not be found. May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-422f4f5f-9c46-4fd4-9207-d5a18121c7c2 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Returning 404 to user: Volume 7175ec56-fc4c-413f-b8e4-914916ef7eac could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-422f4f5f-9c46-4fd4-9207-d5a18121c7c2 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/7175ec56-fc4c-413f-b8e4-914916ef7eac" status: 404 len: 109 microversion: 2.1 time: 0.036621 May 23 18:16:46.907546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 505/1058] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:16:46 2022] DELETE /compute/v2.1/os-volumes/7175ec56-fc4c-413f-b8e4-914916ef7eac => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:46.911627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23541d4e-8fcf-45b7-8b91-19436e307294 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Calling method '.version_select at 0x7f8c1c21ce50>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:46.940046 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-23541d4e-8fcf-45b7-8b91-19436e307294 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] HTTP exception thrown: Volume 1f89e1c7-3155-4852-8a27-811c8eacfcac could not be found. May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23541d4e-8fcf-45b7-8b91-19436e307294 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Request method failure captured: May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/os-volumes/1f89e1c7-3155-4852-8a27-811c8eacfcac HTTP/1.1 May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii8-OWFnDL-2yqICX-m11dGd1ycYvA7so7TX-JPpNzzlwrmFovlsyVxSSCxwLlezV880AptbqU8mGeiBFruvRvpW2XeIVdn1SjxpcUdHVyFI7Dmp7wAb1_JZrBgwcls7u1SgUwkI0VWECitMKvXbmqZMSFGwR4dpDHm-NQwo4Fe10ug8 May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:16:46.941977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb262a49e7943969341fe4844bf6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: fbb262a49e7943969341fe4844bf6ca2 May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesNegativeTest-262427709 May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: b2f00979211947b1b8e04b69c0fbba78 May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesNegativeTest-262427709-project May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Volume 1f89e1c7-3155-4852-8a27-811c8eacfcac could not be found. May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '1f89e1c7-3155-4852-8a27-811c8eacfcac'} May 23 18:16:46.943542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f89e1c7-3155-4852-8a27-811c8eacfcac could not be found. (HTTP 404) (Request-ID: req-b342dc11-a7f0-41f1-a296-a322756337f4) May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.944357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 18:16:46.945549 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f89e1c7-3155-4852-8a27-811c8eacfcac could not be found. May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 18:16:46.947390 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f89e1c7-3155-4852-8a27-811c8eacfcac could not be found. May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f89e1c7-3155-4852-8a27-811c8eacfcac could not be found. May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23541d4e-8fcf-45b7-8b91-19436e307294 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] Returning 404 to user: Volume 1f89e1c7-3155-4852-8a27-811c8eacfcac could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-23541d4e-8fcf-45b7-8b91-19436e307294 tempest-VolumesNegativeTest-262427709 tempest-VolumesNegativeTest-262427709-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1f89e1c7-3155-4852-8a27-811c8eacfcac" status: 404 len: 109 microversion: 2.1 time: 0.036755 May 23 18:16:46.948551 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 554/1059] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:16:46 2022] GET /compute/v2.1/os-volumes/1f89e1c7-3155-4852-8a27-811c8eacfcac => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:16:55.198346 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:55.199535 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:55.204693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9fd8cd4f-06a7-4dd8-bcee-ab7697cc16c1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:55.205667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9fd8cd4f-06a7-4dd8-bcee-ab7697cc16c1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:55.217131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fd8cd4f-06a7-4dd8-bcee-ab7697cc16c1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:55.217615 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fd8cd4f-06a7-4dd8-bcee-ab7697cc16c1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:55.218531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fd8cd4f-06a7-4dd8-bcee-ab7697cc16c1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:55.218999 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fd8cd4f-06a7-4dd8-bcee-ab7697cc16c1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:55.248176 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9fd8cd4f-06a7-4dd8-bcee-ab7697cc16c1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/ips" status: 200 len: 152 microversion: 2.20 time: 0.052414 May 23 18:16:55.248745 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 506/1060] 10.222.0.30 () {60 vars in 1288 bytes} [Mon May 23 18:16:55 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:16:57.117960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=58,nova_cell1:UPDATE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:57.119255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:57.124451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:16:57.124982 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:57.132853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:57.133302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:57.134644 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:57.135109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:57.158041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lazy-loading 'flavor' on Instance uuid b2bb8e05-88ff-4af1-a5d6-23d2348b5178 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:16:57.424803 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4f3414ce-74bf-4d82-9890-e4a7edba3a7e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/action" status: 202 len: 0 microversion: 2.20 time: 0.307810 May 23 18:16:57.428500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 555/1061] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 18:16:57 2022] POST /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 18:16:57.437052 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:57.438280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:57.447567 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:57.448407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:57.449202 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:57.449650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:57.590652 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:57.598780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:57.600286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:57.601452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-904d5d63-39b6-4014-b22c-8b7dcbdb4ef4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.169815 May 23 18:16:57.602012 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 507/1062] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:16:57 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:16:58.620594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:58.621291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:58.627606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:58.628058 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:58.629079 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:58.629510 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:58.755687 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:58.764150 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:58.765664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:58.766850 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-058643a1-83d4-4a36-af1f-e3e471bc33e9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.151040 May 23 18:16:58.767405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 556/1063] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:16:58 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:16:59.785925 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:16:59.786474 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:16:59.793566 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:59.794005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:59.794776 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:16:59.795210 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:16:59.919736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:59.930025 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:59.932114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:16:59.933288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ad2e472f-7338-4ba7-b202-35501ec58a33 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.151389 May 23 18:16:59.933848 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 508/1064] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:16:59 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:00.952153 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:00.952765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:00.959260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:00.959711 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:00.960467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:00.960930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:01.094002 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:01.101816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:01.103360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:01.104508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa169f0c-d1e9-4408-93c9-8df2dc52b429 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.156245 May 23 18:17:01.105057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 557/1065] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:00 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:02.122657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:02.123294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:02.133100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:02.133946 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:02.135268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:02.135941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:02.270357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:02.278894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:02.280393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:02.281548 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0d0417fa-a183-40ab-b770-7fb5131f4eeb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.163021 May 23 18:17:02.282107 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 509/1066] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:02 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:03.300210 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:03.300851 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:03.308200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:03.308674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:03.309441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:03.309877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:03.448139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:03.456094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:03.457637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:03.458816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04f1f72c-4d82-4e09-bdfe-e688a6bb386a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.162450 May 23 18:17:03.459370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 558/1067] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:03 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:04.477008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:04.477674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:04.484316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:04.484870 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:04.485743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:04.486248 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:04.621688 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:04.630154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:04.631675 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:04.632832 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7caf7223-bcad-4f4d-9d17-f7d945e0656e tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.160326 May 23 18:17:04.633372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 510/1068] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:04 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:05.651909 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:05.652513 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:05.658858 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:05.659302 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:05.660053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:05.660480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:05.798993 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:05.807762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:05.809252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:05.810431 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-72484a7d-9e8c-418a-a496-6dcccdf97438 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.162986 May 23 18:17:05.811004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 559/1069] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:05 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:06.829117 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:06.829826 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:06.836368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:06.836821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:06.837583 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:06.838023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:06.979418 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:06.987272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:06.988760 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:06.989915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-92d7836c-986f-4355-ae2d-39c21de61a66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.164823 May 23 18:17:06.990463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 511/1070] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:06 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:08.008703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:08.009397 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:08.016119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:08.016645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:08.017400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:08.017826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:08.169623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:08.177854 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:08.179480 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:08.180677 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5d8dbd48-bc99-4819-973a-f95a93716223 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.175860 May 23 18:17:08.181309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 560/1071] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:08 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:17:09.199275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:09.199907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:09.206467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:09.206940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:09.207700 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:09.208128 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:09.348250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:09.357182 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:09.358818 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:09.360108 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6fb140ff-5f74-49fb-8a1f-aec0ac85abb1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.165229 May 23 18:17:09.360755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 512/1072] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:09 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:10.378964 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:10.379576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:10.386110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:10.386561 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:10.387362 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:10.387803 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:10.516781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:10.524809 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:10.526864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:10.528035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-58f4b4f1-547d-40ac-8e24-52ee56b2837c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.153237 May 23 18:17:10.528582 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 561/1073] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:10 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:11.546277 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:11.546931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:11.553424 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:11.553881 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:11.554646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:11.555114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:11.679096 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:11.687079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:11.688591 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:11.689754 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-532c6deb-15ca-4e95-a444-b3041b2b5011 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.147377 May 23 18:17:11.690320 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 513/1074] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:11 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:12.708353 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:12.708965 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:12.715616 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:12.716064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:12.716822 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:12.717252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:12.848448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:12.857211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:12.858779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:12.859936 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3523fe40-5905-45ae-b609-e941016f9906 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.155463 May 23 18:17:12.860482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 562/1075] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:12 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:13.879035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:13.879649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:13.887002 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:13.887456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:13.888222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:13.888664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:14.017232 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:14.025111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:14.027085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:14.028245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d96b9705-5dd9-4885-8903-4d6bf8b4e5a2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1745 microversion: 2.20 time: 0.153506 May 23 18:17:14.028810 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 514/1076] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:13 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:17:15.046067 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:15.046681 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:15.053115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:15.053566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:15.054358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:15.054817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:15.207391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:15.215781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:15.217303 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:15.218460 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-92a60108-51a4-4a07-a105-0fa8d7486218 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1745 microversion: 2.20 time: 0.176366 May 23 18:17:15.219232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 563/1077] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:15 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:16.237549 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:16.238119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:16.245112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:16.245568 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:16.246339 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:16.246799 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:16.381417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:16.389490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:16.391016 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:16.392300 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04a16ec8-6067-4ac0-bcba-b3a84fd61cdc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1745 microversion: 2.20 time: 0.158955 May 23 18:17:16.392862 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 515/1078] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:16 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:17.411071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:17.411775 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:17.418726 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:17.419313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:17.420211 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:17.420719 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:17.563310 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:17.572196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:17.575816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:17.577289 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e1537310-0ba2-4c5f-9c2e-3d571f163303 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1745 microversion: 2.20 time: 0.170284 May 23 18:17:17.578286 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 564/1079] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:17 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:17.665464 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-f7e71d16-a8b2-4b22-99ce-4d62ca70075a req-7358ec1b-0d2b-43b8-86d6-458485b9eb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bb8e05-88ff-4af1-a5d6-23d2348b5178", "name": "network-vif-plugged", "status": "completed", "tag": "b8d8717a-a013-430f-b363-b78a1d29d611"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:17:17.676450 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f7e71d16-a8b2-4b22-99ce-4d62ca70075a req-7358ec1b-0d2b-43b8-86d6-458485b9eb4d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:17.677321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f7e71d16-a8b2-4b22-99ce-4d62ca70075a req-7358ec1b-0d2b-43b8-86d6-458485b9eb4d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:17.692303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-f7e71d16-a8b2-4b22-99ce-4d62ca70075a req-7358ec1b-0d2b-43b8-86d6-458485b9eb4d service nova] Creating event network-vif-plugged:b8d8717a-a013-430f-b363-b78a1d29d611 for instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 on hv-cinder-75078 May 23 18:17:17.699690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-f7e71d16-a8b2-4b22-99ce-4d62ca70075a req-7358ec1b-0d2b-43b8-86d6-458485b9eb4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038445 May 23 18:17:17.700497 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 516/1080] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:17:18.597177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:18.597798 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:18.605594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:18.606191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:18.606990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:18.607430 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:18.752700 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:18.765949 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:18.767586 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:18.768919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-198eccd2-a869-43b6-8cc9-4565d05d9c66 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1745 microversion: 2.20 time: 0.176944 May 23 18:17:18.775193 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 565/1081] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:18 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:19.789135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:19.789831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:19.796494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:19.796947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:19.797712 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:19.798149 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:19.933813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:19.942020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:19.943702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:19.944872 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b3a6fe74-e1a0-48cd-a810-aa836d9e98d2 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1745 microversion: 2.20 time: 0.160638 May 23 18:17:19.945500 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 517/1082] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:19 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:20.962967 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:20.964061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:20.970546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:20.971027 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:20.971781 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:20.972213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:21.101572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:21.110398 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:21.111956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:21.113126 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c3a5386-5cb5-45b2-9401-628fd0c2ab78 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1745 microversion: 2.20 time: 0.154131 May 23 18:17:21.113986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 566/1083] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:20 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:22.133195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:22.134423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:22.141906 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:22.142360 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:22.143160 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:22.143626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:22.294625 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:22.303456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:22.305890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:22.307286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa19c33a-c8da-4ac7-aa06-d7093fbee53f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.179271 May 23 18:17:22.308422 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 518/1084] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:22 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:23.326516 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:23.327619 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:23.333996 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:23.334447 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:23.335230 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:23.335845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:23.481464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:23.491043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:23.492997 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:23.494286 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3218d68-d716-440d-8abf-a60571d59584 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.172380 May 23 18:17:23.509139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 567/1085] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:23 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:24.516395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:24.517023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:24.524035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:24.524479 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:24.525239 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:24.525904 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:24.688588 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:24.697232 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:24.698932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:24.700242 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b8d9c8fa-2ce3-4595-a33e-c47b4351239f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.187658 May 23 18:17:24.700896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 519/1086] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:24 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:25.719143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:25.720355 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:25.727414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:25.727865 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:25.729321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:25.730136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:25.864138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:25.875011 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:25.876520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:25.877680 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df8325b1-767c-43a7-a4da-dc3cdc3964bd tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.163085 May 23 18:17:25.888895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 568/1087] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:25 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:26.909555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:26.910172 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:26.913932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=29 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:26.917601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:26.918258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:26.919361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:26.920456 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:26.923879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=79 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:27.087655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:27.096899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:27.098408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:27.099610 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-88f12e81-1fd3-46a6-9772-1de69442cfe0 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.194045 May 23 18:17:27.100266 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 520/1088] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:26 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:28.120921 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:28.121528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:28.125321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=29 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:28.129884 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:28.130554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:28.131336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:28.131774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:28.134500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:28.276815 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:28.285539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:28.287072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:28.288225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c6f3e6d7-3221-487e-876f-78cb79d427c3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.172569 May 23 18:17:28.288771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 569/1089] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:28 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:29.310231 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:29.310879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:29.321468 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:29.321928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:29.324780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:29.325503 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:29.480098 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:29.489078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:29.490574 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:29.491989 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2fa2e62b-d423-405a-9286-d9f4524766eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.186621 May 23 18:17:29.492884 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 521/1090] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:29 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:30.519057 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:30.520295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:30.534555 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:30.535117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:30.535953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:30.536449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:30.725729 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:30.734528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:30.736970 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:30.738202 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-570de030-5771-43af-a0ff-9e7d0ea164ae tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.229426 May 23 18:17:30.739088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 570/1091] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:30 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:17:31.757535 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:31.769220 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:31.778327 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:31.779519 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:31.780681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:31.781186 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:31.922759 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:31.935357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:31.961531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:31.963663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-003df299-7ef1-4e4e-b251-0d6dca3c18b6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.209738 May 23 18:17:31.964626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 522/1092] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:31 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:32.982681 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:32.983301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:32.989713 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:32.990155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:32.990930 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:32.991361 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:33.126267 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:33.134624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:33.136173 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:33.137451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-159b4f8e-7d6f-4417-ab51-669a76446445 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1740 microversion: 2.20 time: 0.158874 May 23 18:17:33.138159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 571/1093] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:32 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:34.155737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:34.156349 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:34.171212 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:34.171667 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:34.172439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:34.172876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:34.310391 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:34.318488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:34.320178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:34.321350 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f9ceb8d0-0085-43c4-94d2-361eb3ec6cf6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1722 microversion: 2.20 time: 0.169483 May 23 18:17:34.321904 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 523/1094] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:34 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:35.343978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:35.344872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:35.351280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:35.351833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:35.352588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:35.352927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:35.494327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:35.515401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:35.517100 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:35.518787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0fe74826-dc6e-4337-b21b-bf89e9750e9c tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1722 microversion: 2.20 time: 0.182746 May 23 18:17:35.519775 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 572/1095] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:35 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:35.652760 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-df1b80bd-0be4-4775-a5f6-f07710815af9 req-701e689c-066e-4394-a2a2-7a316efff997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bb8e05-88ff-4af1-a5d6-23d2348b5178", "name": "network-vif-unplugged", "status": "completed", "tag": "b8d8717a-a013-430f-b363-b78a1d29d611"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:17:35.661986 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-df1b80bd-0be4-4775-a5f6-f07710815af9 req-701e689c-066e-4394-a2a2-7a316efff997 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:35.662495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-df1b80bd-0be4-4775-a5f6-f07710815af9 req-701e689c-066e-4394-a2a2-7a316efff997 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:35.676554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-df1b80bd-0be4-4775-a5f6-f07710815af9 req-701e689c-066e-4394-a2a2-7a316efff997 service nova] Creating event network-vif-unplugged:b8d8717a-a013-430f-b363-b78a1d29d611 for instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 on hv-cinder-75078 May 23 18:17:35.682086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-df1b80bd-0be4-4775-a5f6-f07710815af9 req-701e689c-066e-4394-a2a2-7a316efff997 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033830 May 23 18:17:35.683082 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 524/1096] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:17:36.539865 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:36.540479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:36.547756 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:36.548204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:36.548963 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:36.549396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:36.684821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:36.692854 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:36.694356 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:36.695536 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b7eb76f3-abae-4248-bf47-eaf44aa32317 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1665 microversion: 2.20 time: 0.159591 May 23 18:17:36.696096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 573/1097] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:36 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:36.714527 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dd4c6419-2fc0-4424-a430-6f1f15a4e6ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9700494-4ac4-44e2-a427-3c014f16d23d"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:17:36.715708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dd4c6419-2fc0-4424-a430-6f1f15a4e6ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:36.722458 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd4c6419-2fc0-4424-a430-6f1f15a4e6ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:36.722933 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd4c6419-2fc0-4424-a430-6f1f15a4e6ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:36.723704 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd4c6419-2fc0-4424-a430-6f1f15a4e6ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:36.724139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd4c6419-2fc0-4424-a430-6f1f15a4e6ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:37.013293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dd4c6419-2fc0-4424-a430-6f1f15a4e6ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303788 May 23 18:17:37.020679 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 525/1098] 10.222.0.30 () {62 vars in 1363 bytes} [Mon May 23 18:17:36 2022] POST /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 18:17:37.137601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f34e5d1a-eac8-4da7-8d1d-d3f05488fce6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:37.138095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f34e5d1a-eac8-4da7-8d1d-d3f05488fce6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:37.144472 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34e5d1a-eac8-4da7-8d1d-d3f05488fce6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:37.144952 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34e5d1a-eac8-4da7-8d1d-d3f05488fce6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:37.145731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34e5d1a-eac8-4da7-8d1d-d3f05488fce6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:37.146169 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34e5d1a-eac8-4da7-8d1d-d3f05488fce6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:37.381077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f34e5d1a-eac8-4da7-8d1d-d3f05488fce6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-volume_attachments/a9700494-4ac4-44e2-a427-3c014f16d23d" status: 202 len: 0 microversion: 2.20 time: 0.247923 May 23 18:17:37.381666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 574/1099] 10.222.0.30 () {60 vars in 1456 bytes} [Mon May 23 18:17:37 2022] DELETE /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-volume_attachments/a9700494-4ac4-44e2-a427-3c014f16d23d => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 18:17:37.441372 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9b51dcd0-4efd-4783-82ef-1a4afb6fa3b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:17:37.441939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9b51dcd0-4efd-4783-82ef-1a4afb6fa3b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:37.449474 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b51dcd0-4efd-4783-82ef-1a4afb6fa3b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:37.449920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b51dcd0-4efd-4783-82ef-1a4afb6fa3b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:37.450716 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b51dcd0-4efd-4783-82ef-1a4afb6fa3b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:37.451139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b51dcd0-4efd-4783-82ef-1a4afb6fa3b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:37.543788 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9b51dcd0-4efd-4783-82ef-1a4afb6fa3b9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "POST /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/action" status: 202 len: 0 microversion: 2.20 time: 0.106246 May 23 18:17:37.544396 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 526/1100] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 18:17:37 2022] POST /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 18:17:37.552329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:37.553034 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:37.560674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:37.561197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:37.562089 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:37.562564 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:37.742645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:37.752455 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:37.753986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:37.755478 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5a32eaa0-36cf-4db3-ab09-1aa77efddf35 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1673 microversion: 2.20 time: 0.206982 May 23 18:17:37.756024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 575/1101] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:37 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:38.774419 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:38.775112 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:38.781823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:38.782269 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:38.783063 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:38.783499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:38.919286 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:38.927784 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:38.929358 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:38.930544 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-15180b39-3e26-4b45-8865-7cc7b0388510 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.160548 May 23 18:17:38.931158 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 527/1102] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:38 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:39.950439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:39.952010 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:39.959917 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:39.960462 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:39.961309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:39.961837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:40.106294 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:40.114660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:40.116459 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:40.117628 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-86024537-7da6-4118-8ca4-d7939a8321a4 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.172139 May 23 18:17:40.118184 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 576/1103] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:39 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:41.138486 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:41.140304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:41.147060 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:41.147516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:41.148317 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:41.148758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:41.300800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:41.309224 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:41.310743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:41.312162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d6d1fdff-f2bb-412d-a50d-169dd86044f3 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.178328 May 23 18:17:41.312731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 528/1104] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:41 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:42.332412 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:42.332985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:42.340728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:42.341172 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:42.341937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:42.342369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:42.500029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:42.510428 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:42.512278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:42.513694 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-480bb3c0-e221-49ed-988e-fad291ae4dd7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.185278 May 23 18:17:42.514651 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 577/1105] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:42 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:43.534579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:43.535193 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:43.542533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:43.543019 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:43.543793 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:43.546367 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:43.880501 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:43.889400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:43.890928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:43.892071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e1555be-042f-4254-a673-df42ef7ab63a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.362322 May 23 18:17:43.892622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 529/1106] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:43 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:44.912081 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:44.913508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:44.921518 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:44.922069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:44.922951 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:44.923451 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:45.144600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:45.153112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:45.154758 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:45.155983 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-54001dbc-3580-49c4-94e0-d5afd7904fe6 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.248395 May 23 18:17:45.156769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 578/1107] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:44 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:46.174957 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:46.175557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:46.187325 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:46.187780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:46.188572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:46.189004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:46.329542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:46.337458 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:46.340120 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:46.341279 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3698f990-6d38-4716-a874-005c337c3877 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.170203 May 23 18:17:46.342032 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 530/1108] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:46 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:47.360015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:47.360608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:47.369340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:47.369847 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:47.370649 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:47.371112 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:47.508926 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:47.517663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:47.519209 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:47.520371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-172a70cc-1329-49d6-b0b9-25010f45b0f1 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.164284 May 23 18:17:47.520923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 579/1109] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:47 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:48.540524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:48.541651 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:48.548593 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:48.549042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:48.549796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:48.550231 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:48.679236 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:48.687846 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:48.689353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:48.690491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce2c95c0-62a7-4c11-b12e-d6f25cf8d3cf tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.154041 May 23 18:17:48.691073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 531/1110] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:48 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:49.709199 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:49.709835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:49.717045 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:49.717487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:49.718233 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:49.718660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:49.848814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:49.856845 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:49.858327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:49.859492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e92986a-8d4c-49d0-be39-fd3be7c8ebda tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.154172 May 23 18:17:49.860048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 580/1111] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:49 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:50.877259 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:50.877868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:50.884524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:50.885133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:50.885897 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:50.886334 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:51.019080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:51.027506 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:51.029018 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:51.030183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab21bc22-8624-48b5-b6a6-1738d64b8537 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.156814 May 23 18:17:51.030765 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 532/1112] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:50 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:52.048237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:52.048823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:52.055239 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:52.055677 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:52.056425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:52.056856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:52.184396 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:52.192566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:52.194069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:52.195323 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-91e3966f-56b4-424e-9606-f8cec51848df tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.151053 May 23 18:17:52.195867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 581/1113] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:52 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:53.214674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:53.215241 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:53.221641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:53.222114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:53.222908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:53.223416 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:53.355335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:53.357663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:53.364487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:53.365983 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:53.367171 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c247f3cd-7351-4020-a41c-21b78d91e7fb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.157121 May 23 18:17:53.367730 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 533/1114] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:53 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:54.386497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:54.387123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:54.393417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:54.393865 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:54.394630 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:54.395116 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:54.522783 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:54.530770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:54.532297 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:54.533440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5cbd6dcc-2c55-4d79-8a7a-ba2627c52238 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.151488 May 23 18:17:54.534005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 582/1115] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:54 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:55.551940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:55.552555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:55.560760 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:55.561208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:55.561964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:55.562400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:55.695487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:55.703418 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:55.704912 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:55.706061 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e58638cc-dbe8-4cca-b02a-b795cc1fa980 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.158316 May 23 18:17:55.706623 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 534/1116] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:55 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:56.493867 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:17:56.495978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:17:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:17:56.724879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:56.725517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:56.732832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:56.733263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:56.734023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:56.734450 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:56.738536 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:56.885520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:56.893802 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:56.895340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:56.896557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7953f80-6a0c-4ec0-b837-9dac4c415c60 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.175954 May 23 18:17:56.897115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 583/1117] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:56 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 18:17:58.058181 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:58.058896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:58.060746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=32 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:58.066823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:58.067654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:58.068535 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:58.068978 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:58.200297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:58.208208 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:58.209719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:58.210926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c27ea36a-07ca-42b7-bce8-a2428aa2766f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.299122 May 23 18:17:58.211485 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 535/1118] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:57 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:17:59.229120 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:17:59.229671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:17:59.231928 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=30 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:59.237315 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:59.237755 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:59.238505 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:17:59.238970 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:17:59.366804 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:59.375703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:59.377200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:17:59.378375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e9de52f-e1bd-42e2-8273-c43e11279071 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.153487 May 23 18:17:59.378948 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 584/1119] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:17:59 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:00.398170 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:00.398823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:00.405579 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:00.406033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:00.406818 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:00.407260 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:00.542603 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:00.554693 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:00.556235 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:00.557692 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3746db7d-8447-4302-b77f-a32c80f35001 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.163428 May 23 18:18:00.558261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 536/1120] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:00 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:01.576802 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:01.577406 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:01.583927 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:01.584369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:01.585132 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:01.585547 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:01.715542 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:01.723640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:01.725165 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:01.726428 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d3c9b29e-db8c-4771-b381-54bea212b03b tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.154472 May 23 18:18:01.727059 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 585/1121] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:01 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:02.744957 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:02.745542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:02.751627 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:02.752066 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:02.752807 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:02.753236 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:02.881772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:02.890160 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:02.891681 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:02.892824 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-20607115-d7b8-4333-bfae-236f5d60c035 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.151877 May 23 18:18:02.893384 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 537/1122] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:02 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:03.911735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:03.912395 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:03.919589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:03.920032 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:03.920779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:03.921204 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:04.049073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:04.056824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:04.058585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:04.059758 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b732fe38-22db-450c-9ea8-c375fa3fb737 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.151908 May 23 18:18:04.060309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 586/1123] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:03 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:05.077351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:05.077963 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:05.084489 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:05.084947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:05.085738 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:05.086180 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:05.213206 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:05.221641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:05.223189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:05.224347 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6c92e61d-de48-4bbc-92b1-87a6466d3595 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.150968 May 23 18:18:05.224915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 538/1124] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:05 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:06.247434 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:06.248050 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:06.254599 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:06.255327 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:06.256084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:06.256523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:06.384576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:06.392515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:06.394311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:06.395489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-648302d5-acbf-4625-8696-d0b706eea2ea tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.152626 May 23 18:18:06.396144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 587/1125] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:06 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:06.712796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-73363e0c-af35-447f-b881-345291f0b031 req-e60aa9d4-76c3-4648-a5a4-3550c3bb6de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bb8e05-88ff-4af1-a5d6-23d2348b5178", "name": "network-vif-plugged", "status": "completed", "tag": "b8d8717a-a013-430f-b363-b78a1d29d611"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:06.723278 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-73363e0c-af35-447f-b881-345291f0b031 req-e60aa9d4-76c3-4648-a5a4-3550c3bb6de9 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:06.723792 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-73363e0c-af35-447f-b881-345291f0b031 req-e60aa9d4-76c3-4648-a5a4-3550c3bb6de9 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:06.735818 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-73363e0c-af35-447f-b881-345291f0b031 req-e60aa9d4-76c3-4648-a5a4-3550c3bb6de9 service nova] Creating event network-vif-plugged:b8d8717a-a013-430f-b363-b78a1d29d611 for instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 on hv-cinder-75078 May 23 18:18:06.741234 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-73363e0c-af35-447f-b881-345291f0b031 req-e60aa9d4-76c3-4648-a5a4-3550c3bb6de9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 May 23 18:18:06.741825 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 539/1126] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:18:07.413967 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:07.415178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:07.422277 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:07.422762 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:07.423517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:07.424257 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:07.556848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:07.567322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:07.569800 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:07.570113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4a4c6874-377f-4d1f-8711-bb30e4ddb451 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.160130 May 23 18:18:07.570660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 588/1127] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:07 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:08.590240 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:08.590975 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:08.597097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:08.597546 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:08.598303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:08.598766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:08.736789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:08.744635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:08.746357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:08.747539 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-98131fd0-f72c-49eb-bede-74faab6f923f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1731 microversion: 2.20 time: 0.162390 May 23 18:18:08.748096 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 540/1128] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:08 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:09.767696 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:09.768329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:09.774726 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:09.775191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:09.775937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:09.776439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:09.912732 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:09.920122 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:09.921623 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:09.922819 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fcc5b131-b9e0-4820-b1d9-de37121878cb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1718 microversion: 2.20 time: 0.158986 May 23 18:18:09.923361 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 589/1129] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:18:09 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:18:17.614563 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1b8534b2-7d65-46e3-ba74-366edf0ef928 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:17.615086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1b8534b2-7d65-46e3-ba74-366edf0ef928 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:17.621867 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b8534b2-7d65-46e3-ba74-366edf0ef928 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:17.622315 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b8534b2-7d65-46e3-ba74-366edf0ef928 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:17.623103 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b8534b2-7d65-46e3-ba74-366edf0ef928 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:17.623547 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b8534b2-7d65-46e3-ba74-366edf0ef928 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:17.646419 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1b8534b2-7d65-46e3-ba74-366edf0ef928 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/ips" status: 200 len: 145 microversion: 2.1 time: 0.035712 May 23 18:18:17.647000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 541/1130] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:18:17 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:18:18.958524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ee52f94-4610-4f7c-84c6-a08d18629174 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d3a7f3a-3864-45d0-a639-596102e525f9"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:18.959669 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ee52f94-4610-4f7c-84c6-a08d18629174 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:18.966878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee52f94-4610-4f7c-84c6-a08d18629174 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:18.967329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee52f94-4610-4f7c-84c6-a08d18629174 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:18.968090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee52f94-4610-4f7c-84c6-a08d18629174 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:18.968527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ee52f94-4610-4f7c-84c6-a08d18629174 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:19.204131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ee52f94-4610-4f7c-84c6-a08d18629174 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249228 May 23 18:18:19.204731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 590/1131] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:18:18 2022] POST /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:18:28.830575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-19edd543-66ae-46ff-bf0c-25baeb8f20b1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:28.831530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-19edd543-66ae-46ff-bf0c-25baeb8f20b1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:28.835093 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=13 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:28.835726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=43 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:28.839457 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19edd543-66ae-46ff-bf0c-25baeb8f20b1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:28.839919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19edd543-66ae-46ff-bf0c-25baeb8f20b1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:28.840752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19edd543-66ae-46ff-bf0c-25baeb8f20b1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:28.841191 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19edd543-66ae-46ff-bf0c-25baeb8f20b1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:28.873683 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-19edd543-66ae-46ff-bf0c-25baeb8f20b1 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 May 23 18:18:28.878903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 542/1132] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:18:28 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:18:28.885474 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2e480bfd-b563-4028-b5dc-aed780a3642c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:28.886388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2e480bfd-b563-4028-b5dc-aed780a3642c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:28.893650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e480bfd-b563-4028-b5dc-aed780a3642c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:28.894107 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e480bfd-b563-4028-b5dc-aed780a3642c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:28.894910 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e480bfd-b563-4028-b5dc-aed780a3642c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:28.895352 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e480bfd-b563-4028-b5dc-aed780a3642c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:28.899138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:28.926746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2e480bfd-b563-4028-b5dc-aed780a3642c tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/9d3a7f3a-3864-45d0-a639-596102e525f9" status: 200 len: 194 microversion: 2.1 time: 0.046101 May 23 18:18:28.927330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 591/1133] 10.222.0.30 () {58 vars in 1412 bytes} [Mon May 23 18:18:28 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/9d3a7f3a-3864-45d0-a639-596102e525f9 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:18:34.423838 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2026248064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1307402015", "security_groups": [{"name": "tempest-secgroup-smoke-1146479828"}], "block_device_mapping_v2": [{"uuid": "62b64677-d146-4d64-b99b-382a29fb8342", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1d3a1f7-b777-4042-a243-d14c937aea70"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:34.451814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-61a39bb8-fde5-4dda-921c-65b09c5559a2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d1eaba2-e132-4181-aa3d-5fc5aabf1fdb"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:34.452932 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-61a39bb8-fde5-4dda-921c-65b09c5559a2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:34.455324 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=16 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:34.460642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61a39bb8-fde5-4dda-921c-65b09c5559a2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:34.461082 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61a39bb8-fde5-4dda-921c-65b09c5559a2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:34.461870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61a39bb8-fde5-4dda-921c-65b09c5559a2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:34.462359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61a39bb8-fde5-4dda-921c-65b09c5559a2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:34.558854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] validate_networks() for [('a1d3a1f7-b777-4042-a243-d14c937aea70', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:18:34.721891 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-61a39bb8-fde5-4dda-921c-65b09c5559a2 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "POST /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273721 May 23 18:18:34.723191 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 592/1134] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:18:34 2022] POST /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:18:34.976027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:18:34.976448 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:18:34.976920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:18:34.977316 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:18:34.977758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:18:34.989880 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:34.990324 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:34.991185 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:34.991619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:35.009792 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:18:35.014361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Getting quotas for user 06b8d18d37e7467f84841ec6ac0080fb and project 99bc86fccaff473aaa2ee8b35c7a357f. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:18:35.070168 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:18:35.072487 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62b64677-d146-4d64-b99b-382a29fb8342',volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:18:35.204475 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0e2c1560-e31e-4439-ad70-ea2691c817ab tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784687 May 23 18:18:35.205414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 543/1135] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:18:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:18:35.216212 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5cc21aa9-a962-4063-9850-4d072f5decc1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:35.216912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5cc21aa9-a962-4063-9850-4d072f5decc1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:35.275064 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5cc21aa9-a962-4063-9850-4d072f5decc1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:35.282173 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5cc21aa9-a962-4063-9850-4d072f5decc1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1095 microversion: 2.1 time: 0.070697 May 23 18:18:35.282768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 593/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:35 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:36.298666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:36.299309 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:36.305413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:36.305870 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:36.306636 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:36.307142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:36.370113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:36.377543 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7ff6c643-0325-4997-aabe-2a06918d78c2 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1211 microversion: 2.1 time: 0.083206 May 23 18:18:36.378250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 544/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:36 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:37.395832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:37.396475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:37.405795 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:37.406539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:37.407358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:37.407787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:37.612448 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:37.620166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30b29768-9892-4a39-b6c3-d439b832c30c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1279 microversion: 2.1 time: 0.228021 May 23 18:18:37.620748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 594/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:37 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1279 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:18:37.935130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-0b577652-5c24-4999-bfe7-c782c02c0846 req-1ce13e11-cf85-468d-bd2f-b38de5eb48bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274d9f7b-e9f8-4065-8b03-bc1d808d5cc1", "tag": "cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:37.951756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-0b577652-5c24-4999-bfe7-c782c02c0846 req-1ce13e11-cf85-468d-bd2f-b38de5eb48bb service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:37.953048 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-0b577652-5c24-4999-bfe7-c782c02c0846 req-1ce13e11-cf85-468d-bd2f-b38de5eb48bb service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:37.971217 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-0b577652-5c24-4999-bfe7-c782c02c0846 req-1ce13e11-cf85-468d-bd2f-b38de5eb48bb service nova] Creating event network-changed:cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b for instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 on hv-cinder-75078 May 23 18:18:37.982427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-0b577652-5c24-4999-bfe7-c782c02c0846 req-1ce13e11-cf85-468d-bd2f-b38de5eb48bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054691 May 23 18:18:37.983491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 545/1139] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:18:38.637982 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:38.638594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:38.645123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:38.645576 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:38.646335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:38.646795 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:38.875522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:38.883144 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-05469b49-a62f-4ea3-a574-2f2414f919c8 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1279 microversion: 2.1 time: 0.249638 May 23 18:18:38.883702 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 595/1140] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:38 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:39.902023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:39.902740 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:39.909494 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:39.909941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:39.910687 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:39.911139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:40.043022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:40.050725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-605742b2-5894-4fb2-b38c-2640b71a1397 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1279 microversion: 2.1 time: 0.153606 May 23 18:18:40.051305 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 546/1141] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:39 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:41.067739 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:41.068271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:41.074878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:41.075320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:41.076069 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:41.076499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:41.210810 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:41.219000 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d36f4d39-e2a6-4326-84b5-06c39c3c8d89 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1279 microversion: 2.1 time: 0.155101 May 23 18:18:41.219566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 596/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:41 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:42.236057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:42.236729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:42.241375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c9d5db16-a583-4f34-9081-5819485500dc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:42.242351 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c9d5db16-a583-4f34-9081-5819485500dc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:42.242616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.243095 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.243859 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.244290 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.249713 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9d5db16-a583-4f34-9081-5819485500dc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.250155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9d5db16-a583-4f34-9081-5819485500dc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.250950 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9d5db16-a583-4f34-9081-5819485500dc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.251385 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9d5db16-a583-4f34-9081-5819485500dc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.283029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c9d5db16-a583-4f34-9081-5819485500dc tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045403 May 23 18:18:42.283725 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 597/1143] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:18:42 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:18:42.383289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:42.391409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7e4de7c4-ae6d-419e-93ef-a21869f37e09 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.159659 May 23 18:18:42.391919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 547/1144] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:42 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:42.423757 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e3af485a-1501-4e5f-b4bc-4da085a56152 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:42.424232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e3af485a-1501-4e5f-b4bc-4da085a56152 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:42.430227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3af485a-1501-4e5f-b4bc-4da085a56152 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.430663 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3af485a-1501-4e5f-b4bc-4da085a56152 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.431436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3af485a-1501-4e5f-b4bc-4da085a56152 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.431864 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3af485a-1501-4e5f-b4bc-4da085a56152 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.461331 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e3af485a-1501-4e5f-b4bc-4da085a56152 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/9d3a7f3a-3864-45d0-a639-596102e525f9" status: 200 len: 194 microversion: 2.1 time: 0.042111 May 23 18:18:42.462052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 598/1145] 10.222.0.30 () {58 vars in 1412 bytes} [Mon May 23 18:18:42 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/9d3a7f3a-3864-45d0-a639-596102e525f9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:18:42.471709 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:42.472247 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:42.478186 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.478649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.479443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:42.479886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:42.560891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lazy-loading 'services' on Instance uuid 8ad49721-4ef6-421a-bc3a-da1673c723db {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:18:42.632763 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7bc9778b-cc69-4389-8c83-bfebbf9c5fdf tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/9d3a7f3a-3864-45d0-a639-596102e525f9" status: 202 len: 0 microversion: 2.1 time: 0.164824 May 23 18:18:42.633349 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 548/1146] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:18:42 2022] DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/9d3a7f3a-3864-45d0-a639-596102e525f9 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:18:43.409203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:43.409815 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:43.416313 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:43.416763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:43.417639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:43.418178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:43.552370 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:43.560281 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3be899cd-4199-456b-8c51-2616c142d857 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.154430 May 23 18:18:43.560816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 599/1147] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:43 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:44.577472 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:44.578164 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:44.584913 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:44.585357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:44.586105 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:44.586536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:44.715263 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:44.723378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-76398e5e-40c7-442a-9c76-c474f1acf5b5 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.150105 May 23 18:18:44.723937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 549/1148] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:44 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:44.796787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-18e920b3-c848-4d38-b80e-ad6726fe9953 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:44.797301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-18e920b3-c848-4d38-b80e-ad6726fe9953 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:44.803808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18e920b3-c848-4d38-b80e-ad6726fe9953 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:44.804260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18e920b3-c848-4d38-b80e-ad6726fe9953 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:44.805015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18e920b3-c848-4d38-b80e-ad6726fe9953 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:44.805449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18e920b3-c848-4d38-b80e-ad6726fe9953 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:44.833558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-18e920b3-c848-4d38-b80e-ad6726fe9953 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/5d1eaba2-e132-4181-aa3d-5fc5aabf1fdb" status: 200 len: 194 microversion: 2.1 time: 0.040832 May 23 18:18:44.834114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 600/1149] 10.222.0.30 () {58 vars in 1412 bytes} [Mon May 23 18:18:44 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/5d1eaba2-e132-4181-aa3d-5fc5aabf1fdb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:18:44.844197 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:44.844718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:44.850616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:44.851098 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:44.851847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:44.852275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:44.932723 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lazy-loading 'services' on Instance uuid 8ad49721-4ef6-421a-bc3a-da1673c723db {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:18:45.001674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:45.003608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8a01a7a6-87f9-4f44-9c31-9f5e858812d0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/5d1eaba2-e132-4181-aa3d-5fc5aabf1fdb" status: 202 len: 0 microversion: 2.1 time: 0.163801 May 23 18:18:45.004195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 550/1150] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:18:44 2022] DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments/5d1eaba2-e132-4181-aa3d-5fc5aabf1fdb => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:18:45.741021 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:45.741629 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:45.743590 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:45.749545 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:45.749992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:45.750793 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:45.751213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:45.885812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:45.893291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fb51ab5a-cda6-4705-bdd9-918c0012c1a7 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.156225 May 23 18:18:45.893847 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 601/1151] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:45 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:46.166252 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:46.171954 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-342f9134-5d1d-4bf3-a75f-0aa1d3da59b8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:46.173044 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-342f9134-5d1d-4bf3-a75f-0aa1d3da59b8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:46.180174 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342f9134-5d1d-4bf3-a75f-0aa1d3da59b8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.180623 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342f9134-5d1d-4bf3-a75f-0aa1d3da59b8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.181383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342f9134-5d1d-4bf3-a75f-0aa1d3da59b8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.181817 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342f9134-5d1d-4bf3-a75f-0aa1d3da59b8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.210453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-342f9134-5d1d-4bf3-a75f-0aa1d3da59b8 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044998 May 23 18:18:46.211030 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 551/1152] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:18:46 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:18:46.316253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81f0a5ea-1be0-44b0-9e1d-1801833dbc5d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:46.317220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-81f0a5ea-1be0-44b0-9e1d-1801833dbc5d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:46.323198 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81f0a5ea-1be0-44b0-9e1d-1801833dbc5d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.323650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81f0a5ea-1be0-44b0-9e1d-1801833dbc5d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.324438 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81f0a5ea-1be0-44b0-9e1d-1801833dbc5d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.324878 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81f0a5ea-1be0-44b0-9e1d-1801833dbc5d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.357401 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-81f0a5ea-1be0-44b0-9e1d-1801833dbc5d tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044299 May 23 18:18:46.358335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 602/1153] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:18:46 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:18:46.414428 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:46.415006 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:46.422030 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.422476 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.423280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.423726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.448321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:18:46.525053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1939da12-3a94-4c49-9ff7-097b57cccc7e tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 204 len: 0 microversion: 2.1 time: 0.113888 May 23 18:18:46.525435 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 552/1154] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:18:46 2022] DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:18:46.533371 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:46.533982 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:46.540041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.540485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.541237 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.541666 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.668808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:46.676796 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c1da4bd-b86e-4813-ab30-04fabb7c7ca0 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1673 microversion: 2.1 time: 0.147198 May 23 18:18:46.677348 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 603/1155] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:46 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:46.911186 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:46.911883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:46.917937 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.918435 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:46.920138 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:46.920585 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:47.062682 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:47.070102 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-366c2ad1-3a5a-4edc-9300-b49b884e8eb6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.163246 May 23 18:18:47.070665 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 553/1156] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:46 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:47.694436 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:47.695077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:47.701699 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:47.702153 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:47.702952 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:47.703391 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:47.832437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:47.839826 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af12afd7-5ef8-4e76-8de8-ddba652e8e78 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1673 microversion: 2.1 time: 0.149344 May 23 18:18:47.840386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 604/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:47 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:48.088413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:48.088978 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:48.099703 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:48.100432 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:48.101768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:48.102411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:48.231329 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:48.239361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1762bd73-fbb7-4646-952b-45418a53bd60 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.154975 May 23 18:18:48.239928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 554/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:48 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:48.857941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:48.858490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:48.864872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:48.865312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:48.866056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:48.866484 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:48.994272 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:49.002260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db4d0170-d14a-454e-9ee6-9f498e09aa13 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1673 microversion: 2.1 time: 0.148366 May 23 18:18:49.002844 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 605/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:48 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:49.257137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:49.257755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:49.264249 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:49.264698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:49.265459 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:49.265899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:49.397877 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:49.405840 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8c8da6ec-c624-461d-b54c-871601b63fad tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.152779 May 23 18:18:49.406409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 555/1160] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:49 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:50.019908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:50.020532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:50.027133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:50.027587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:50.028358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:50.028792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:50.206429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d08ba344a9349d99de16520d3ce5150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00ef21138204550843697c5f33a8999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:50.213902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a89d5816-5810-445a-bcf4-9611944703b3 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 200 len: 1673 microversion: 2.1 time: 0.197814 May 23 18:18:50.214464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 606/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:50 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:50.423768 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:50.424395 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:50.430907 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:50.431359 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:50.432131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:50.432569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:50.532178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-81f0b3ca-fa66-472f-a20b-410ca69fe20b req-82c44e49-f8e7-4277-846e-d0e95bba7127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad49721-4ef6-421a-bc3a-da1673c723db", "name": "network-vif-deleted", "tag": "8d540380-8b34-4b72-8925-5ba0df6a12d6"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:50.540998 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-81f0b3ca-fa66-472f-a20b-410ca69fe20b req-82c44e49-f8e7-4277-846e-d0e95bba7127 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:50.540998 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-81f0b3ca-fa66-472f-a20b-410ca69fe20b req-82c44e49-f8e7-4277-846e-d0e95bba7127 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:50.553920 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-81f0b3ca-fa66-472f-a20b-410ca69fe20b req-82c44e49-f8e7-4277-846e-d0e95bba7127 service nova] Creating event network-vif-deleted:8d540380-8b34-4b72-8925-5ba0df6a12d6 for instance 8ad49721-4ef6-421a-bc3a-da1673c723db on hv-cinder-75078 May 23 18:18:50.559962 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-81f0b3ca-fa66-472f-a20b-410ca69fe20b req-82c44e49-f8e7-4277-846e-d0e95bba7127 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031765 May 23 18:18:50.561072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 607/1162] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:18:50.581398 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:50.585012 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:50.589841 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2909b070-4e34-42b8-9ef8-ac00003b739a tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.170957 May 23 18:18:50.594960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 556/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:50 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:51.233813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:51.235296 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:51.241768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:51.242416 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:51.243490 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:51.243931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:51.248748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:51.265723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] HTTP exception thrown: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Request method failure captured: May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db HTTP/1.1 May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii82CyItBTSoroux5ItMu69j4Yv04ataAHIZSxpRW0OOv03LVNWad8u6WDjpHU2yWia17xVjFbn_OrDWsnStrDj3sXhwup_OLNCTvTvizldrsvXcaHEFJwBEh1pVN_la44bWkHPZOqF4DSU1nPa-7jzQcBscZ_UfCEqy5HwV-kHn5Khg May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:18:51.267785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e00ef21138204550843697c5f33a8999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e00ef21138204550843697c5f33a8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 8d08ba344a9349d99de16520d3ce5150 May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:51.269248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '8ad49721-4ef6-421a-bc3a-da1673c723db'} May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:18:51.270061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:51.271604 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:51.272956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Returning 404 to user: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:18:51.272956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-da3afb8c-d7b5-4915-bdd8-9b1f1068d1c4 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 404 len: 111 microversion: 2.1 time: 0.041014 May 23 18:18:51.272956 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 608/1164] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:51 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 18:18:51.278828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4d22c8b9-e5aa-4d3a-a7ec-9d0eb25e2c65 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '.version_select at 0x7f8c16fabb80>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:51.305611 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4d22c8b9-e5aa-4d3a-a7ec-9d0eb25e2c65 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165364544" status: 202 len: 0 microversion: 2.1 time: 0.030777 May 23 18:18:51.306604 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 557/1165] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 18:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165364544 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:18:51.608457 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:51.609075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:51.617072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:51.617072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:51.617602 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:51.618242 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:51.749820 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:51.757846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa4ddc70-232a-4129-a548-d1bfb5ebd4bf tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.153881 May 23 18:18:51.758414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 609/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:51 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:52.776341 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:52.777071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:52.783507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:52.783955 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:52.784782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:52.785209 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:52.927269 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-6b022ff3-735b-41b3-8df8-745e972f34bd req-5ef6fdb3-b9c1-4b9c-ba79-4020f3243443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274d9f7b-e9f8-4065-8b03-bc1d808d5cc1", "name": "network-vif-plugged", "status": "completed", "tag": "cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:52.928870 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:52.935501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6b022ff3-735b-41b3-8df8-745e972f34bd req-5ef6fdb3-b9c1-4b9c-ba79-4020f3243443 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:52.936633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6b022ff3-735b-41b3-8df8-745e972f34bd req-5ef6fdb3-b9c1-4b9c-ba79-4020f3243443 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:52.937160 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6951bf24-cd6b-45e0-8b8a-a63247d54e64 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.165684 May 23 18:18:52.937550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 558/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:52 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:52.949566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-6b022ff3-735b-41b3-8df8-745e972f34bd req-5ef6fdb3-b9c1-4b9c-ba79-4020f3243443 service nova] Creating event network-vif-plugged:cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b for instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 on hv-cinder-75078 May 23 18:18:52.955085 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-6b022ff3-735b-41b3-8df8-745e972f34bd req-5ef6fdb3-b9c1-4b9c-ba79-4020f3243443 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165496 May 23 18:18:52.955645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 610/1168] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:18:53.954341 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:53.954995 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:53.961427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:53.961877 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:53.962630 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:53.963093 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:54.094005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:54.101430 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-57484075-4d26-4357-8930-e0f7ab04b2e6 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1267 microversion: 2.1 time: 0.151745 May 23 18:18:54.102211 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 559/1169] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:53 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:54.233365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:54.233899 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:54.240488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:54.240931 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:54.241684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:54.242114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:54.256525 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] HTTP exception thrown: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Request method failure captured: May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db HTTP/1.1 May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii82CyItBTSoroux5ItMu69j4Yv04ataAHIZSxpRW0OOv03LVNWad8u6WDjpHU2yWia17xVjFbn_OrDWsnStrDj3sXhwup_OLNCTvTvizldrsvXcaHEFJwBEh1pVN_la44bWkHPZOqF4DSU1nPa-7jzQcBscZ_UfCEqy5HwV-kHn5Khg May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:18:54.258158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e00ef21138204550843697c5f33a8999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e00ef21138204550843697c5f33a8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 8d08ba344a9349d99de16520d3ce5150 May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.259764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '8ad49721-4ef6-421a-bc3a-da1673c723db'} May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:18:54.260603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.262055 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:54.263504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Returning 404 to user: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:18:54.263504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4f3124be-6994-437e-ac7f-8d309859ace5 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 404 len: 111 microversion: 2.1 time: 0.030427 May 23 18:18:54.263504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 611/1170] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:18:54 2022] DELETE /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:18:54.270172 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:54.270824 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 8ad49721-4ef6-421a-bc3a-da1673c723db] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:54.276903 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:54.277425 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:54.278223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:54.278657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:54.293565 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] HTTP exception thrown: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Request method failure captured: May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db HTTP/1.1 May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii82CyItBTSoroux5ItMu69j4Yv04ataAHIZSxpRW0OOv03LVNWad8u6WDjpHU2yWia17xVjFbn_OrDWsnStrDj3sXhwup_OLNCTvTvizldrsvXcaHEFJwBEh1pVN_la44bWkHPZOqF4DSU1nPa-7jzQcBscZ_UfCEqy5HwV-kHn5Khg May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:18:54.295382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e00ef21138204550843697c5f33a8999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e00ef21138204550843697c5f33a8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 8d08ba344a9349d99de16520d3ce5150 May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.296960 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '8ad49721-4ef6-421a-bc3a-da1673c723db'} May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:18:54.297801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. May 23 18:18:54.299287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:54.300622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Returning 404 to user: Instance 8ad49721-4ef6-421a-bc3a-da1673c723db could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:18:54.300622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fc8b5b9c-7286-487b-a60f-db69523c3805 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db" status: 404 len: 111 microversion: 2.1 time: 0.030633 May 23 18:18:54.300622 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 560/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:54 2022] GET /compute/v2.1/servers/8ad49721-4ef6-421a-bc3a-da1673c723db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:18:55.117353 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:55.118077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:55.125701 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.126233 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.127118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.133742 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.267960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:55.275520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a18617c7-fbf0-43e6-a643-1ac120d766f3 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1455 microversion: 2.1 time: 0.162054 May 23 18:18:55.276082 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 612/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:55 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:55.291540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:55.292154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:55.299506 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.299962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.300727 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.301166 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.440113 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:18:55.442091 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:55.442595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:55.448765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.449800 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.450587 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.451096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.461078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-55b44db4-67c0-4951-8f08-7cb628a2b6e9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1455 microversion: 2.1 time: 0.173002 May 23 18:18:55.462575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 561/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:55 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:18:55.467578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] HTTP exception thrown: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Request method failure captured: May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 HTTP/1.1 May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii82CyItBTSoroux5ItMu69j4Yv04ataAHIZSxpRW0OOv03LVNWad8u6WDjpHU2yWia17xVjFbn_OrDWsnStrDj3sXhwup_OLNCTvTvizldrsvXcaHEFJwBEh1pVN_la44bWkHPZOqF4DSU1nPa-7jzQcBscZ_UfCEqy5HwV-kHn5Khg May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:18:55.468808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e00ef21138204550843697c5f33a8999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e00ef21138204550843697c5f33a8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 8d08ba344a9349d99de16520d3ce5150 May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.470219 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '03538a0b-c9de-4f9a-826d-72679e1fde88'} May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:18:55.471342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.472645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:18:55.473863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Returning 404 to user: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:18:55.473863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e1001ae-feff-43a8-8e02-b329679cbe0b tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 404 len: 111 microversion: 2.1 time: 0.031942 May 23 18:18:55.473863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 613/1174] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:18:55 2022] DELETE /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 18:18:55.479440 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:18:55.480047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] [instance: 03538a0b-c9de-4f9a-826d-72679e1fde88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:18:55.488290 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.488737 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.489686 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:55.490131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:55.506939 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] HTTP exception thrown: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Request method failure captured: May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 HTTP/1.1 May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii82CyItBTSoroux5ItMu69j4Yv04ataAHIZSxpRW0OOv03LVNWad8u6WDjpHU2yWia17xVjFbn_OrDWsnStrDj3sXhwup_OLNCTvTvizldrsvXcaHEFJwBEh1pVN_la44bWkHPZOqF4DSU1nPa-7jzQcBscZ_UfCEqy5HwV-kHn5Khg May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:18:55.513121 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e00ef21138204550843697c5f33a8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e00ef21138204550843697c5f33a8999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e00ef21138204550843697c5f33a8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: e00ef21138204550843697c5f33a8999 May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1512431520 May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 8d08ba344a9349d99de16520d3ce5150 May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeTestJSON-1512431520-project May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.514814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '03538a0b-c9de-4f9a-826d-72679e1fde88'} May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:18:55.515702 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. May 23 18:18:55.517142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:18:55.518238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] Returning 404 to user: Instance 03538a0b-c9de-4f9a-826d-72679e1fde88 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:18:55.518238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a89a9dc1-a820-473b-8b1d-75692539d730 tempest-AttachVolumeTestJSON-1512431520 tempest-AttachVolumeTestJSON-1512431520-project] 10.222.0.30 "GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88" status: 404 len: 111 microversion: 2.1 time: 0.040767 May 23 18:18:55.518238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 562/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:18:55 2022] GET /compute/v2.1/servers/03538a0b-c9de-4f9a-826d-72679e1fde88 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:18:57.466326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-27202c49-e80d-4f74-8475-c483b4868d75 req-2597f7c2-969a-49d1-b6e1-f23c3e2dca08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274d9f7b-e9f8-4065-8b03-bc1d808d5cc1", "tag": "cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:18:57.479473 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-27202c49-e80d-4f74-8475-c483b4868d75 req-2597f7c2-969a-49d1-b6e1-f23c3e2dca08 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:18:57.480129 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-27202c49-e80d-4f74-8475-c483b4868d75 req-2597f7c2-969a-49d1-b6e1-f23c3e2dca08 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:18:57.494357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-27202c49-e80d-4f74-8475-c483b4868d75 req-2597f7c2-969a-49d1-b6e1-f23c3e2dca08 service nova] Creating event network-changed:cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b for instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 on hv-cinder-75078 May 23 18:18:57.500916 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-27202c49-e80d-4f74-8475-c483b4868d75 req-2597f7c2-969a-49d1-b6e1-f23c3e2dca08 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038940 May 23 18:18:57.502314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 614/1176] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:01.791845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0acedcfe-e6c8-45df-bde0-992e2280dff6 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c202e29d0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:01.839976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0acedcfe-e6c8-45df-bde0-992e2280dff6 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9903a722-6fd3-4bfc-ba29-dc10804c7a04" status: 200 len: 350 microversion: 2.1 time: 0.051892 May 23 18:19:01.840536 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 563/1177] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:19:01 2022] GET /compute/v2.1/os-volumes/9903a722-6fd3-4bfc-ba29-dc10804c7a04 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:03.152439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a868d70e-117b-4141-81b1-21472f493bb7 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c1677b0d0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:03.200036 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a868d70e-117b-4141-81b1-21472f493bb7 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9de455b0-479b-4ff5-b7f5-73da69896c7b" status: 200 len: 351 microversion: 2.1 time: 0.051706 May 23 18:19:03.200599 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 615/1178] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:19:03 2022] GET /compute/v2.1/os-volumes/9de455b0-479b-4ff5-b7f5-73da69896c7b => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:04.512766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aaede5ab-913d-4275-8054-684cbbab9802 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c202afa60>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:04.559378 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aaede5ab-913d-4275-8054-684cbbab9802 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c71ed6ce-11f5-4ad0-b7b2-ffb6cfae463d" status: 200 len: 350 microversion: 2.1 time: 0.050873 May 23 18:19:04.559966 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 564/1179] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 18:19:04 2022] GET /compute/v2.1/os-volumes/c71ed6ce-11f5-4ad0-b7b2-ffb6cfae463d => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:04.571814 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-812936c6-b0b2-418b-8d93-15030ac6cec9 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c1c080430>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:04.651200 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-812936c6-b0b2-418b-8d93-15030ac6cec9 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083658 May 23 18:19:04.651764 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 616/1180] 10.222.0.30 () {58 vars in 1133 bytes} [Mon May 23 18:19:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:04.664287 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c32c9285-0ea1-4421-96a5-a97a5bf44fa7 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c202af8b0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:04.746789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c32c9285-0ea1-4421-96a5-a97a5bf44fa7 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086079 May 23 18:19:04.747346 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 565/1181] 10.222.0.30 () {58 vars in 1148 bytes} [Mon May 23 18:19:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:04.759365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-685176a3-168a-4643-90b5-e9a28857b09b tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c1c401160>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:04.841529 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-685176a3-168a-4643-90b5-e9a28857b09b tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085684 May 23 18:19:04.842769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 617/1182] 10.222.0.30 () {58 vars in 1133 bytes} [Mon May 23 18:19:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:04.853822 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-704756bb-32f1-4244-939f-fc3dd75a057a tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c1c3b4d30>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:04.933619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-704756bb-32f1-4244-939f-fc3dd75a057a tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083567 May 23 18:19:04.934191 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 566/1183] 10.222.0.30 () {58 vars in 1166 bytes} [Mon May 23 18:19:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:04.946215 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-701ecb0a-beec-4c56-bf3c-aa6cf8b1100c tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c1c11a820>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:05.024425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-701ecb0a-beec-4c56-bf3c-aa6cf8b1100c tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081885 May 23 18:19:05.024995 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 618/1184] 10.222.0.30 () {58 vars in 1169 bytes} [Mon May 23 18:19:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:05.036558 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d0974a7-7a25-4564-902d-9096877512e6 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c1c038700>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:05.115151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d0974a7-7a25-4564-902d-9096877512e6 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082159 May 23 18:19:05.115739 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 567/1185] 10.222.0.30 () {58 vars in 1154 bytes} [Mon May 23 18:19:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:05.127557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-74dc40c4-7b3c-4df0-9c84-b3bbe0d64389 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c1c47eca0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:05.207523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-74dc40c4-7b3c-4df0-9c84-b3bbe0d64389 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084407 May 23 18:19:05.208140 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 619/1186] 10.222.0.30 () {58 vars in 1187 bytes} [Mon May 23 18:19:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:05.219562 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3174c531-e52b-4829-9a18-5210d05c1229 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] Calling method '.version_select at 0x7f8c202ceb80>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:05.301623 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3174c531-e52b-4829-9a18-5210d05c1229 tempest-VolumesTestJSON-382943058 tempest-VolumesTestJSON-382943058-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085760 May 23 18:19:05.302192 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 568/1187] 10.222.0.30 () {58 vars in 1154 bytes} [Mon May 23 18:19:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:17.094243 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=47 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:17.095007 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=21 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:17.099014 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d170a4f1-d736-41ab-aec9-8a74be72b209 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:17.100001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d170a4f1-d736-41ab-aec9-8a74be72b209 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:17.108019 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d170a4f1-d736-41ab-aec9-8a74be72b209 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:17.108394 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d170a4f1-d736-41ab-aec9-8a74be72b209 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:17.109170 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d170a4f1-d736-41ab-aec9-8a74be72b209 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:17.109603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d170a4f1-d736-41ab-aec9-8a74be72b209 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:17.137877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d170a4f1-d736-41ab-aec9-8a74be72b209 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044922 May 23 18:19:17.138464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 620/1188] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 18:19:17 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:17.193273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:17.194066 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=22 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:17.198575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:17.199093 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:17.206954 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:17.207402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:17.208294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:17.208803 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:17.234885 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:19:17.311520 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5e8c4f68-0ab9-4019-b535-e62b172e06d7 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 204 len: 0 microversion: 2.20 time: 0.117982 May 23 18:19:17.312391 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 569/1189] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 18:19:17 2022] DELETE /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 18:19:17.321532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:17.322066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:17.329130 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:17.329579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:17.330330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:17.330795 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:17.458136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:17.466048 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:17.467622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:17.468761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a0c9efe7-fd3a-44dc-b051-ede93f85013d tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.151375 May 23 18:19:17.469312 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 621/1190] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:17 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:19:18.487648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:18.488376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:18.494814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:18.495268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:18.496023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:18.496458 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:18.627267 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:18.635513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:18.637010 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:18.638165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f825120-44ab-4226-84fe-35562e516d0f tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.154788 May 23 18:19:18.639272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 570/1191] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:18 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:19:19.656894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:19.657498 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:19.663987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:19.664432 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:19.665188 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:19.665615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:19.793857 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:19.802360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:19.803901 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:19.805059 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a4bc8679-dd68-4806-81a5-80b9ba7a0dbc tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.152904 May 23 18:19:19.805617 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 622/1192] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:19 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:19:20.823324 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:20.823946 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:20.830437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:20.830927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:20.831690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:20.832130 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:20.958671 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:20.966739 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:20.968319 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:20.969491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4008d551-523f-4eab-af0c-55681bdc5ae9 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.150136 May 23 18:19:20.970040 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 571/1193] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:20 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:19:21.987719 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:21.988326 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:21.994906 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:21.995363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:21.996119 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:21.996548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:22.125238 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:22.133446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:22.135003 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:22.136169 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7d72f95d-352b-4f38-b243-9dfa19a20f99 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.152421 May 23 18:19:22.136724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 623/1194] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:21 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:19:23.159162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:23.160648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:23.172863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:23.173357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:23.174521 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:23.175133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:23.320854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:23.329247 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:23.330756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:23.331929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-37245c87-f093-458b-81fb-1be98212114a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1724 microversion: 2.20 time: 0.180064 May 23 18:19:23.332493 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 572/1195] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:23 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:19:24.064422 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-0e3ca6a8-985b-4b1b-929d-fde240d3b3f1 req-4995a288-cc35-4892-972f-42fcccf83808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bb8e05-88ff-4af1-a5d6-23d2348b5178", "name": "network-vif-deleted", "tag": "b8d8717a-a013-430f-b363-b78a1d29d611"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:19:24.072614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0e3ca6a8-985b-4b1b-929d-fde240d3b3f1 req-4995a288-cc35-4892-972f-42fcccf83808 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:24.073301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0e3ca6a8-985b-4b1b-929d-fde240d3b3f1 req-4995a288-cc35-4892-972f-42fcccf83808 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:24.085615 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-0e3ca6a8-985b-4b1b-929d-fde240d3b3f1 req-4995a288-cc35-4892-972f-42fcccf83808 service nova] Creating event network-vif-deleted:b8d8717a-a013-430f-b363-b78a1d29d611 for instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 on hv-cinder-75078 May 23 18:19:24.090943 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-0e3ca6a8-985b-4b1b-929d-fde240d3b3f1 req-4995a288-cc35-4892-972f-42fcccf83808 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 May 23 18:19:24.091827 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 624/1196] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:24.350782 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:24.351408 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:24.358104 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:24.358641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:24.359444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:24.359884 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:24.391746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:24.392202 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:24.392655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lazy-loading 'fault' on Instance uuid b2bb8e05-88ff-4af1-a5d6-23d2348b5178 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:19:24.438481 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:24.449122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:24.451480 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e9879d092b4c819f1f5607f42cc364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69b4fff47194d4fbd1188521b31dce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:24.453122 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-de69b65e-6b13-4da2-b280-9b1b2c0521eb tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 200 len: 1371 microversion: 2.20 time: 0.106047 May 23 18:19:24.453855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 573/1197] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:24 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 18:19:25.473223 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:25.473921 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:25.480167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:25.480619 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:25.481384 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:25.481821 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:25.494844 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] HTTP exception thrown: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Request method failure captured: May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 HTTP/1.1 May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii817BOJJD8xDgzpjRhkutgckcmYHWrYZmM5k2-sxtWSeXnimG1V2qLN3C00SkdfqzYjDBvlpnq8sB57NDx6YhSewcrlwcccCkmMQXrdQ4w9Wmk6raBGCjVDdRwzkG5drVlYzBVlHWypCWmW1wlkzBkFeGVzt0LFM9R7OKIH11hu-jkc May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Openstack-Nova-Api-Version: 2.20 May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:19:25.496444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 32e9879d092b4c819f1f5607f42cc364 May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:25.498375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'b2bb8e05-88ff-4af1-a5d6-23d2348b5178'} May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:19:25.499231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:25.500728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:25.502136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Returning 404 to user: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:19:25.502136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4e87b3d9-9a27-4fb9-8af1-92a57cc5990a tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 404 len: 111 microversion: 2.20 time: 0.029352 May 23 18:19:25.502136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 625/1198] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:25 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 18:19:25.507142 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-56b42f43-bdd4-4798-ae81-0faed7779e10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '.version_select at 0x7f8c202a0ca0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:25.525531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-56b42f43-bdd4-4798-ae81-0faed7779e10 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109014482" status: 204 len: 0 microversion: 2.20 time: 0.022580 May 23 18:19:25.526126 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 574/1199] 10.222.0.30 () {60 vars in 1261 bytes} [Mon May 23 18:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109014482 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 18:19:27.549076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:27.549574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:27.556250 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:27.557255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:27.558027 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:27.558482 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:27.572509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] HTTP exception thrown: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Request method failure captured: May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 HTTP/1.1 May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii817BOJJD8xDgzpjRhkutgckcmYHWrYZmM5k2-sxtWSeXnimG1V2qLN3C00SkdfqzYjDBvlpnq8sB57NDx6YhSewcrlwcccCkmMQXrdQ4w9Wmk6raBGCjVDdRwzkG5drVlYzBVlHWypCWmW1wlkzBkFeGVzt0LFM9R7OKIH11hu-jkc May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Openstack-Nova-Api-Version: 2.20 May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:19:27.574471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 32e9879d092b4c819f1f5607f42cc364 May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.576065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'b2bb8e05-88ff-4af1-a5d6-23d2348b5178'} May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:19:27.576902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.579393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:27.580848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Returning 404 to user: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:19:27.580848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e0c2b4bb-0506-42b5-80aa-6b6c716a9773 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 404 len: 111 microversion: 2.20 time: 0.031210 May 23 18:19:27.580848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 626/1200] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 18:19:27 2022] DELETE /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 18:19:27.585674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:27.586282 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: b2bb8e05-88ff-4af1-a5d6-23d2348b5178] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:27.592799 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:27.594126 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:27.594917 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:27.595351 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:27.609012 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] HTTP exception thrown: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Request method failure captured: May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 HTTP/1.1 May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii817BOJJD8xDgzpjRhkutgckcmYHWrYZmM5k2-sxtWSeXnimG1V2qLN3C00SkdfqzYjDBvlpnq8sB57NDx6YhSewcrlwcccCkmMQXrdQ4w9Wmk6raBGCjVDdRwzkG5drVlYzBVlHWypCWmW1wlkzBkFeGVzt0LFM9R7OKIH11hu-jkc May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Openstack-Nova-Api-Version: 2.20 May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:19:27.610726 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 32e9879d092b4c819f1f5607f42cc364 May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.612344 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'b2bb8e05-88ff-4af1-a5d6-23d2348b5178'} May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:19:27.613423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. May 23 18:19:27.614920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:27.616557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Returning 404 to user: Instance b2bb8e05-88ff-4af1-a5d6-23d2348b5178 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:19:27.616557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2dbd1851-501e-4f1d-8ac5-2fc901762369 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178" status: 404 len: 111 microversion: 2.20 time: 0.030984 May 23 18:19:27.616557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 575/1201] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:27 2022] GET /compute/v2.1/servers/b2bb8e05-88ff-4af1-a5d6-23d2348b5178 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 18:19:28.749153 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:28.749769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:28.757311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:28.757311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:28.757985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:28.758411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:28.771812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] HTTP exception thrown: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Request method failure captured: May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c HTTP/1.1 May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii817BOJJD8xDgzpjRhkutgckcmYHWrYZmM5k2-sxtWSeXnimG1V2qLN3C00SkdfqzYjDBvlpnq8sB57NDx6YhSewcrlwcccCkmMQXrdQ4w9Wmk6raBGCjVDdRwzkG5drVlYzBVlHWypCWmW1wlkzBkFeGVzt0LFM9R7OKIH11hu-jkc May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Openstack-Nova-Api-Version: 2.20 May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:19:28.773341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 32e9879d092b4c819f1f5607f42cc364 May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.776052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'ebec7dc8-9547-4dac-9035-078304c6793c'} May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:19:28.777142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.779013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:19:28.781341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Returning 404 to user: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:19:28.781341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-638ea3fa-2232-4ce7-87df-1215033c3767 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 404 len: 111 microversion: 2.20 time: 0.029471 May 23 18:19:28.781341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 627/1202] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 18:19:28 2022] DELETE /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 18:19:28.784762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:28.785412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] [instance: ebec7dc8-9547-4dac-9035-078304c6793c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:28.791583 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:28.792144 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:28.792901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:28.793329 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:28.807483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] HTTP exception thrown: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Request method failure captured: May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c HTTP/1.1 May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii817BOJJD8xDgzpjRhkutgckcmYHWrYZmM5k2-sxtWSeXnimG1V2qLN3C00SkdfqzYjDBvlpnq8sB57NDx6YhSewcrlwcccCkmMQXrdQ4w9Wmk6raBGCjVDdRwzkG5drVlYzBVlHWypCWmW1wlkzBkFeGVzt0LFM9R7OKIH11hu-jkc May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Openstack-Nova-Api-Version: 2.20 May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:19:28.809000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c69b4fff47194d4fbd1188521b31dce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: c69b4fff47194d4fbd1188521b31dce8 May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-232945662 May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 32e9879d092b4c819f1f5607f42cc364 May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-232945662-project May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.810663 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'ebec7dc8-9547-4dac-9035-078304c6793c'} May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:19:28.811559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. May 23 18:19:28.813662 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:19:28.814990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] Returning 404 to user: Instance ebec7dc8-9547-4dac-9035-078304c6793c could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:19:28.814990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b287d54e-e6f1-4bee-841d-673bb3aa2340 tempest-AttachVolumeShelveTestJSON-232945662 tempest-AttachVolumeShelveTestJSON-232945662-project] 10.222.0.30 "GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c" status: 404 len: 111 microversion: 2.20 time: 0.030504 May 23 18:19:28.814990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 576/1203] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 18:19:28 2022] GET /compute/v2.1/servers/ebec7dc8-9547-4dac-9035-078304c6793c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 18:19:37.396656 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2de8ef3-3826-402f-bbad-7f1f2e131628 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: .version_select at 0x7f8c1c1ccee0>, body: {"keypair": {"name": "tempest-keypair-722461495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWnWjT56yrEgdWCqu8hh7bJ2wYoYnTZAkshT0DvU3R2SyZc10rzuE8KR077S4C1vl/PnHCUpYbKkRP7KDqdJFyeT2EY2eTyyWV3tJqK+4WPW3XsJ8t95qkeT3cKYOIsew=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:19:37.413464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-c2de8ef3-3826-402f-bbad-7f1f2e131628 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:19:37.417589 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-c2de8ef3-3826-402f-bbad-7f1f2e131628 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:19:37.445988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2de8ef3-3826-402f-bbad-7f1f2e131628 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183426 May 23 18:19:37.453344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 628/1204] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:19:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:38.825833 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-313739970", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41737fbe-3e3b-40d5-8d40-17f54e449570"}], "security_groups": [{"name": "tempest-securitygroup--329843875"}], "key_name": "tempest-keypair-722461495", "user_data": "}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:19:38.833464 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:38.834261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:38.945330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] validate_networks() for [('41737fbe-3e3b-40d5-8d40-17f54e449570', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:19:39.314673 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:19:39.315205 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:19:39.315684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:19:39.316096 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:19:39.316534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:19:39.325295 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:39.325746 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:39.326542 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:39.327011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:39.345858 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:19:39.349845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:19:39.361748 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:19:39.364140 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:19:39.415801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-60e2234a-c4cc-4543-91c0-2bb813012301 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594159 May 23 18:19:39.418043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 577/1205] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:19:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:19:39.425342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=32 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:39.430541 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b18a392e-f70d-4a23-a29a-7bd99ff1c860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:39.431656 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b18a392e-f70d-4a23-a29a-7bd99ff1c860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:39.501469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b18a392e-f70d-4a23-a29a-7bd99ff1c860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:39.513288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b18a392e-f70d-4a23-a29a-7bd99ff1c860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1240 microversion: 2.1 time: 0.089822 May 23 18:19:39.514441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 629/1206] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:39 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:19:40.529453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:40.530058 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:40.537280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:40.537729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:40.538497 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:40.538964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:40.602932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:40.610719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e14b7640-c926-48f2-84e2-684fc077b97c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1244 microversion: 2.1 time: 0.085030 May 23 18:19:40.611309 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 578/1207] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:40 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:41.627140 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:41.628101 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:41.636381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:41.636837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:41.637613 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:41.638051 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:41.706178 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:41.716234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fad9aafb-059d-4a48-b94b-e336050bae19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1236 microversion: 2.1 time: 0.093341 May 23 18:19:41.728770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 630/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:41 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:42.736238 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:42.737007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:42.744023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:42.744477 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:42.745302 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:42.745680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:42.900492 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:42.908919 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a64babac-9ce5-4365-9449-7ddc55e8e3c0 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.177405 May 23 18:19:42.910069 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 579/1209] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:42 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:43.756673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-34fb9ade-7858-4ff0-964b-3562b9751e24 req-cac57433-4548-490b-a047-5ae878e680e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793cf2d1-4755-4a20-a541-f77a7d0f7385", "tag": "aea586da-7173-4540-aa53-a24534ffb2c4"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:19:43.773745 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-34fb9ade-7858-4ff0-964b-3562b9751e24 req-cac57433-4548-490b-a047-5ae878e680e5 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:43.774517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-34fb9ade-7858-4ff0-964b-3562b9751e24 req-cac57433-4548-490b-a047-5ae878e680e5 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:43.786473 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-34fb9ade-7858-4ff0-964b-3562b9751e24 req-cac57433-4548-490b-a047-5ae878e680e5 service nova] Creating event network-changed:aea586da-7173-4540-aa53-a24534ffb2c4 for instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 on hv-cinder-75078 May 23 18:19:43.791207 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-34fb9ade-7858-4ff0-964b-3562b9751e24 req-cac57433-4548-490b-a047-5ae878e680e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047111 May 23 18:19:43.791865 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 631/1210] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:43.926889 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:43.927531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:43.933990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:43.934434 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:43.935221 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:43.935657 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:44.062431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:44.070109 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9a9299ef-4cd5-41bd-af11-f945b9aca2ec tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.147118 May 23 18:19:44.070680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 580/1211] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:43 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:19:45.087895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:45.088601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:45.095457 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:45.095907 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:45.096675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:45.097109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:45.225528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:45.232843 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-65b8a7ee-75db-4d69-8e5b-13184a23dc7f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.149611 May 23 18:19:45.233405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 632/1212] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:45 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:46.249762 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:46.250318 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:46.256362 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:46.257057 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:46.257827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:46.258265 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:46.387833 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:46.395894 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a5511728-b9d4-4156-ac51-70173f2bcc46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.150464 May 23 18:19:46.396451 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 581/1213] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:46 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:47.412097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:47.412709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:47.415117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:47.420227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:47.420671 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:47.422062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:47.422489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:47.556481 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:47.564295 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2a914149-c7a1-4a88-b3a5-bce422c943f5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.155939 May 23 18:19:47.564866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 633/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:47 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:48.581916 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:48.582688 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:48.591318 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:48.591787 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:48.592545 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:48.593089 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:48.724929 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:48.734850 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-26494a85-88f8-4bf2-a7c4-708541df65ae tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.156726 May 23 18:19:48.735373 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 582/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:48 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:19:49.751634 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:49.752249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:49.754601 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:49.760609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:49.761062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:49.761825 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:49.762266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:49.896156 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:49.903855 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5def5126-2cf3-4fae-ad97-d11e76aa1a1a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.156537 May 23 18:19:49.904483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 634/1216] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:49 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:50.920234 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:50.920851 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:50.923525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:50.924187 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:50.931303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:50.931756 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:50.932517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:50.932956 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:51.067439 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:51.074860 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba3391ec-ec75-416e-8554-ff0d0c19e938 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.158469 May 23 18:19:51.075424 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 583/1217] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:50 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:52.091793 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:52.092402 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:52.099522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:52.099966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:52.100714 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:52.101143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:52.235953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:52.243992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-904949d5-f62c-4aef-9b5e-3263bfeda91a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.155950 May 23 18:19:52.244571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 635/1218] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:52 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:19:52.377116 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-b95cdb77-4cac-4ba2-95a8-6dc6245fdd6c req-d2e461ed-94dd-4caa-b2bc-0b75f758375b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793cf2d1-4755-4a20-a541-f77a7d0f7385", "name": "network-vif-plugged", "status": "completed", "tag": "aea586da-7173-4540-aa53-a24534ffb2c4"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:19:52.386725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b95cdb77-4cac-4ba2-95a8-6dc6245fdd6c req-d2e461ed-94dd-4caa-b2bc-0b75f758375b service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:52.387273 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b95cdb77-4cac-4ba2-95a8-6dc6245fdd6c req-d2e461ed-94dd-4caa-b2bc-0b75f758375b service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:52.399118 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-b95cdb77-4cac-4ba2-95a8-6dc6245fdd6c req-d2e461ed-94dd-4caa-b2bc-0b75f758375b service nova] Creating event network-vif-plugged:aea586da-7173-4540-aa53-a24534ffb2c4 for instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 on hv-cinder-75078 May 23 18:19:52.405898 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-b95cdb77-4cac-4ba2-95a8-6dc6245fdd6c req-d2e461ed-94dd-4caa-b2bc-0b75f758375b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032637 May 23 18:19:52.407189 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 584/1219] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:19:53.261732 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:53.262253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:53.268833 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:53.269273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:53.270439 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:53.270908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:53.401028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:53.408978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-287be14e-7a70-4ca5-b109-d72667cefb2c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.151243 May 23 18:19:53.409532 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 636/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:53 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:54.427131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:54.427850 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:54.434195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:54.434642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:54.435433 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:54.435869 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:54.570115 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:54.577489 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8826a56f-57a2-4462-be59-85c9559ce691 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.155145 May 23 18:19:54.578137 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 585/1221] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:54 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:55.594812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:55.595424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:55.601893 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:55.602337 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:55.603123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:55.603579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:55.729769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:55.737464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-29724ff3-2f33-4cfd-a9ca-4a80224fa9cd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.146560 May 23 18:19:55.738052 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 637/1222] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:55 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:56.753601 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:56.754214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:56.761031 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:56.761507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:56.762267 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:56.762722 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:56.901947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:56.910411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1f2c09e3-4a38-4c0b-8fb9-9f947c179e4d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.160945 May 23 18:19:56.911014 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 586/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:56 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:57.927001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:57.927617 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:57.934097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:57.934543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:57.935338 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:57.935774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:58.061785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:58.069337 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b8d1df59-5447-49ae-afc4-1a29b858a362 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1365 microversion: 2.1 time: 0.146217 May 23 18:19:58.069905 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 638/1224] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:57 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:19:59.086355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:59.087136 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:59.095376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:59.095820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:59.096609 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:59.097041 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:59.239642 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:19:59.247138 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-232dddba-6f29-4a86-bc2b-717ca5d1fd34 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1555 microversion: 2.1 time: 0.164585 May 23 18:19:59.247695 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 587/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:19:59 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:19:59.264147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2dbd2e8-3948-48b0-a4ed-53e9d1f7fc3c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:19:59.264735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2dbd2e8-3948-48b0-a4ed-53e9d1f7fc3c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:19:59.272072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2e8-3948-48b0-a4ed-53e9d1f7fc3c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:59.272528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2e8-3948-48b0-a4ed-53e9d1f7fc3c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:59.273504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2e8-3948-48b0-a4ed-53e9d1f7fc3c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:19:59.273987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2e8-3948-48b0-a4ed-53e9d1f7fc3c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:19:59.354139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2dbd2e8-3948-48b0-a4ed-53e9d1f7fc3c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094073 May 23 18:19:59.354788 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 639/1226] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:19:59 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:20:00.268680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-28cfdfc3-b993-4a99-a52e-12c7e33ad019 req-a497b12c-e15a-4dff-806e-e43536cf8d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793cf2d1-4755-4a20-a541-f77a7d0f7385", "tag": "aea586da-7173-4540-aa53-a24534ffb2c4"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:20:00.278000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-28cfdfc3-b993-4a99-a52e-12c7e33ad019 req-a497b12c-e15a-4dff-806e-e43536cf8d19 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:00.278731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-28cfdfc3-b993-4a99-a52e-12c7e33ad019 req-a497b12c-e15a-4dff-806e-e43536cf8d19 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:00.290325 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-28cfdfc3-b993-4a99-a52e-12c7e33ad019 req-a497b12c-e15a-4dff-806e-e43536cf8d19 service nova] Creating event network-changed:aea586da-7173-4540-aa53-a24534ffb2c4 for instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 on hv-cinder-75078 May 23 18:20:00.295813 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-28cfdfc3-b993-4a99-a52e-12c7e33ad019 req-a497b12c-e15a-4dff-806e-e43536cf8d19 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031446 May 23 18:20:00.296616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 588/1227] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:20:18.625890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=13 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:18.626567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=54 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:18.816727 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2f6a8e45-44a6-4302-a71f-c78fac05b243 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Action: 'create', calling method: .version_select at 0x7f8c1671a5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-653903503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV05hsWd2/kRlpoR/N2D5W1OrHPCu2AW2vNDhBeX3GW5ya0irHp73IeACokBx8iEN+tDNEx1/hTw4ho5IskHbdjpQ9sDidX716k36FQZ5lkTjXusMIAOfmbI6xThD1eDg=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:20:18.834088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-2f6a8e45-44a6-4302-a71f-c78fac05b243 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Getting quotas for project 9b4b5edf7a064c2eb276bdf2c418f26e. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:20:18.838677 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-2f6a8e45-44a6-4302-a71f-c78fac05b243 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Getting quotas for user 2f8e89084a2344cdb89889d7d5744b8b and project 9b4b5edf7a064c2eb276bdf2c418f26e. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:20:18.862732 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2f6a8e45-44a6-4302-a71f-c78fac05b243 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.238997 May 23 18:20:18.863344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 640/1228] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:20:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:20:47.523428 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:47.524900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=60 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:47.529656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1313895022", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-653903503", "security_groups": [{"name": "tempest-secgroup-smoke-802041415"}], "networks": [{"uuid": "d890884c-675e-45c5-85d2-1fa75bad267a"}], "block_device_mapping_v2": [{"uuid": "916dd8a7-a126-4a15-bef7-f15b5b2dfeb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:20:47.640110 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] validate_networks() for [('d890884c-675e-45c5-85d2-1fa75bad267a', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:20:48.004367 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:20:48.004795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:20:48.005270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:20:48.005680 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:20:48.006127 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:20:48.016572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:48.017039 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:48.017818 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:48.018255 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:48.034772 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Getting quotas for project 9b4b5edf7a064c2eb276bdf2c418f26e. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:20:48.038855 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Getting quotas for user 2f8e89084a2344cdb89889d7d5744b8b and project 9b4b5edf7a064c2eb276bdf2c418f26e. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:20:48.095826 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:20:48.098023 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='916dd8a7-a126-4a15-bef7-f15b5b2dfeb4',volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:20:48.222811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d42a1f85-3a04-4de0-9530-079dc36bbb2a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.701163 May 23 18:20:48.223454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 589/1229] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:20:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:20:48.230870 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:48.231613 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:48.235981 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c52d415d-5401-433a-83d9-5a31c327f907 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:48.236609 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c52d415d-5401-433a-83d9-5a31c327f907 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:48.299122 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c52d415d-5401-433a-83d9-5a31c327f907 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:48.308637 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c52d415d-5401-433a-83d9-5a31c327f907 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1088 microversion: 2.1 time: 0.079216 May 23 18:20:48.309201 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 641/1230] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:48 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:49.329070 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:49.329660 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:49.337811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:49.338258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:49.339058 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:49.339488 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:49.410388 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:49.418097 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba64f8b1-f66f-4c67-a9b9-30a1b3d17a81 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1204 microversion: 2.1 time: 0.095393 May 23 18:20:49.419087 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 590/1231] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:49 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:50.436608 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:50.437788 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:50.443974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:50.444492 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:50.445318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:50.445883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:50.663887 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:50.673328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-328545f3-2c9c-48bc-b11e-f19f67a3188d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.240765 May 23 18:20:50.673940 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 642/1232] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:50 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:20:50.922744 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-3025bc0e-d329-4c67-856f-804c6ff823a5 req-95e81490-4e2c-4c22-8654-6a54ecfb71c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425499e2-c18d-425b-9f3f-3a0ac9d65426", "tag": "14368b46-7e98-4c81-99a9-5e8b1acaf41f"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:20:50.931480 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3025bc0e-d329-4c67-856f-804c6ff823a5 req-95e81490-4e2c-4c22-8654-6a54ecfb71c8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:50.932644 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3025bc0e-d329-4c67-856f-804c6ff823a5 req-95e81490-4e2c-4c22-8654-6a54ecfb71c8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:50.947443 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-3025bc0e-d329-4c67-856f-804c6ff823a5 req-95e81490-4e2c-4c22-8654-6a54ecfb71c8 service nova] Creating event network-changed:14368b46-7e98-4c81-99a9-5e8b1acaf41f for instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 on hv-cinder-75078 May 23 18:20:50.954270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-3025bc0e-d329-4c67-856f-804c6ff823a5 req-95e81490-4e2c-4c22-8654-6a54ecfb71c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159134 May 23 18:20:50.955355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 591/1233] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:20:51.691016 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:51.691664 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:51.698090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:51.698528 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:51.699301 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:51.699730 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:51.827420 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:51.834949 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b3f5888e-a285-429c-a845-48a68c5fc725 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.148459 May 23 18:20:51.835509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 643/1234] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:51 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:52.853228 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:52.853923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:52.860694 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:52.861139 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:52.861908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:52.862343 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:52.997345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:53.005618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cbb3d0af-c764-45e5-b94c-26d3cf61b6d5 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.157098 May 23 18:20:53.006195 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 592/1235] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:52 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:54.023696 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:54.024311 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:54.030514 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:54.031040 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:54.031866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:54.032304 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:54.164423 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:54.172095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-48d6babf-dd52-4135-8072-a0ed695c4771 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.152085 May 23 18:20:54.172770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 644/1236] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:54 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:55.189193 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:55.189798 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:55.196343 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:55.196789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:55.197545 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:55.197980 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:55.330301 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:55.337664 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5efe7f0f-186a-4405-87a9-2219ac501e13 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.152549 May 23 18:20:55.338224 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 593/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:55 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:56.355109 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:56.355728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:56.362977 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:56.363457 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:56.364220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:56.364655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:56.496785 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:56.504613 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7f636c93-4c89-4127-925c-fa614f94ed44 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.153476 May 23 18:20:56.505180 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 645/1238] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:56 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:57.521376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:57.521909 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:57.528463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:57.528918 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:57.529684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:57.530124 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:57.661132 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:57.668572 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5c86879b-a4eb-47b5-9ae3-b247761d5225 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.151170 May 23 18:20:57.669126 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 594/1239] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:57 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:58.687607 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:58.688594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:58.690988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:58.696524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:58.696988 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:58.697763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:58.698189 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:58.880900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:20:58.889912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-800fad92-ee86-4c66-a29c-ddd5d87a6061 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.207858 May 23 18:20:58.891358 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 646/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:58 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:20:59.790690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:59.791190 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:59.799390 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:59.800190 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:59.806950 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:59.807402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:59.808167 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:59.808779 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:59.836140 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:20:59.868249 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-9b20b6bd-ce20-4c34-9641-878f06ef05c0 req-a2018fba-e867-461a-9183-545533d213be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274d9f7b-e9f8-4065-8b03-bc1d808d5cc1", "tag": "cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:20:59.876597 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9b20b6bd-ce20-4c34-9641-878f06ef05c0 req-a2018fba-e867-461a-9183-545533d213be service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:59.877035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9b20b6bd-ce20-4c34-9641-878f06ef05c0 req-a2018fba-e867-461a-9183-545533d213be service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:59.888789 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-9b20b6bd-ce20-4c34-9641-878f06ef05c0 req-a2018fba-e867-461a-9183-545533d213be service nova] Creating event network-changed:cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b for instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 on hv-cinder-75078 May 23 18:20:59.894885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-9b20b6bd-ce20-4c34-9641-878f06ef05c0 req-a2018fba-e867-461a-9183-545533d213be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101882 May 23 18:20:59.895689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 647/1241] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:20:59.909709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:59.910780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:59.917584 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:59.918099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:59.918923 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:59.919501 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:59.947727 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-020b312a-66a2-41e9-916d-0851e4205367 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "DELETE /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 204 len: 0 microversion: 2.1 time: 0.158728 May 23 18:20:59.949135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 595/1242] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:20:59 2022] DELETE /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:20:59.960732 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:20:59.961755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:20:59.968856 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:59.969645 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:20:59.970887 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:20:59.971332 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:00.094689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:00.102985 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-409d7267-1b52-40b2-a340-90aceb723eae tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.199106 May 23 18:21:00.103560 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 648/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:59 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:21:00.114905 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:00.122437 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e1b2c3b9-ea14-4ab6-8c63-3b02ba32f591 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1579 microversion: 2.1 time: 0.167748 May 23 18:21:00.123040 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 596/1244] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:20:59 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:01.120005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:01.120624 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:01.127281 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:01.127733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:01.128515 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:01.128953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:01.141843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:01.142454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:01.156792 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:01.157304 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:01.158120 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:01.158588 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:01.306632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:01.315723 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b1e480d4-91c8-432d-8874-e0eb47377afd tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1579 microversion: 2.1 time: 0.178278 May 23 18:21:01.316620 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 597/1245] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:01 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:01.317808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:01.326883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-51c08fc0-6353-4043-b405-975b926420b9 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.210754 May 23 18:21:01.327972 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 649/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:01 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:02.176229 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-844d5183-d7f4-463e-9356-d89f0f0e5592 req-4132b4cc-a52b-4cca-9502-401778d09db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274d9f7b-e9f8-4065-8b03-bc1d808d5cc1", "name": "network-vif-deleted", "tag": "cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:02.184918 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-844d5183-d7f4-463e-9356-d89f0f0e5592 req-4132b4cc-a52b-4cca-9502-401778d09db2 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:02.185363 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-844d5183-d7f4-463e-9356-d89f0f0e5592 req-4132b4cc-a52b-4cca-9502-401778d09db2 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:02.197251 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-844d5183-d7f4-463e-9356-d89f0f0e5592 req-4132b4cc-a52b-4cca-9502-401778d09db2 service nova] Creating event network-vif-deleted:cc59c3d5-0c7e-4bcf-a991-d11ef9060c5b for instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 on hv-cinder-75078 May 23 18:21:02.201912 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-844d5183-d7f4-463e-9356-d89f0f0e5592 req-4132b4cc-a52b-4cca-9502-401778d09db2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029546 May 23 18:21:02.203177 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 598/1247] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:02.332883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:02.333499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:02.340061 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:02.340457 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:02.341224 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:02.341665 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:02.344820 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:02.345513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:02.351635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:02.352080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:02.352869 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:02.353328 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:02.406463 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:02.414115 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ff90aa51-bc5f-40aa-928f-1ff60de5d1b9 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 200 len: 1226 microversion: 2.1 time: 0.085040 May 23 18:21:02.414690 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 650/1248] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:02 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:02.570556 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:02.579608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-822e388c-9b45-472d-8d80-f1cbfd669eac tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.239106 May 23 18:21:02.580540 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 599/1249] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:02 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:21:02.631524 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-27e251c9-597b-41dc-b2b4-37e4fd45a062 req-c5f1c834-03b9-4daf-b104-526494eef18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425499e2-c18d-425b-9f3f-3a0ac9d65426", "name": "network-vif-plugged", "status": "completed", "tag": "14368b46-7e98-4c81-99a9-5e8b1acaf41f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:02.641479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-27e251c9-597b-41dc-b2b4-37e4fd45a062 req-c5f1c834-03b9-4daf-b104-526494eef18f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:02.642118 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-27e251c9-597b-41dc-b2b4-37e4fd45a062 req-c5f1c834-03b9-4daf-b104-526494eef18f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:02.654633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-27e251c9-597b-41dc-b2b4-37e4fd45a062 req-c5f1c834-03b9-4daf-b104-526494eef18f service nova] Creating event network-vif-plugged:14368b46-7e98-4c81-99a9-5e8b1acaf41f for instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 on hv-cinder-75078 May 23 18:21:02.661070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-27e251c9-597b-41dc-b2b4-37e4fd45a062 req-c5f1c834-03b9-4daf-b104-526494eef18f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034980 May 23 18:21:02.662020 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 651/1250] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:03.431262 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:03.431924 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:03.439539 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:03.439989 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:03.440752 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:03.441199 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:03.455544 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] HTTP exception thrown: Instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 could not be found. May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Request method failure captured: May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 HTTP/1.1 May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii84Fo5o7NoIUMuKVO-r3n143JV7ia4m31xCkqj7I2N8_74rhJiXqScVp5ILL7ZdbLD_XNjCu0o92eL-xEvSSfH8WLYdevYPLDAK7jVfkIHG4vZjF_9uumK04eDG6uNMjL3W9RsRWoP7bRdpaQ_7IhmF_-ORw2gEUZ_WXnX4FwaOVdAU May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:21:03.457196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-TestVolumeBootPattern-292797858 May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 06b8d18d37e7467f84841ec6ac0080fb May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 could not be found. May 23 18:21:03.459007 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '274d9f7b-e9f8-4065-8b03-bc1d808d5cc1'} May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 could not be found. May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:21:03.459984 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 could not be found. May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 could not be found. May 23 18:21:03.461598 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:03.463022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Returning 404 to user: Instance 274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:21:03.463022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5be501ef-9919-45f9-bc20-64b18f5269ac tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1" status: 404 len: 111 microversion: 2.1 time: 0.031419 May 23 18:21:03.463022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 600/1251] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:03 2022] GET /compute/v2.1/servers/274d9f7b-e9f8-4065-8b03-bc1d808d5cc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:21:03.597316 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:03.598045 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:03.604611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:03.605060 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:03.605818 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:03.606260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:03.738719 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:03.746469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-77c132e0-d2a5-4732-a0c3-7bd5f44a8dda tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.153550 May 23 18:21:03.747135 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 652/1252] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:03 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:04.763409 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:04.764284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:04.771329 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:04.771771 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:04.772528 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:04.772978 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:04.903882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:04.911787 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-686041bf-dd1c-44bd-9bfd-17a163206434 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1259 microversion: 2.1 time: 0.152267 May 23 18:21:04.912350 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 601/1253] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:04 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:05.928703 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:05.929384 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:05.936136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:05.936585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:05.938377 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:05.939018 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.075114 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:06.083271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a2637309-9638-4ed1-b253-8af92198e06a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1442 microversion: 2.1 time: 0.158452 May 23 18:21:06.096799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 653/1254] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:05 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:06.109333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:06.111223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:06.119086 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:06.119544 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.120326 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:06.120769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.344151 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:06.351683 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9dea71cd-5065-404a-8d11-5097735b700f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1442 microversion: 2.1 time: 0.248736 May 23 18:21:06.352453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 602/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:06 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1442 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:06.619748 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:06.620253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:06.625553 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-e71b4a14-961c-4f0c-a144-f25e8f23f5de req-726de5e7-a61f-4825-93aa-dc665423e1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e", "tag": "cdf88afb-8339-4273-a911-bc3379093276"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:06.637883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e71b4a14-961c-4f0c-a144-f25e8f23f5de req-726de5e7-a61f-4825-93aa-dc665423e1fc service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:06.638331 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e71b4a14-961c-4f0c-a144-f25e8f23f5de req-726de5e7-a61f-4825-93aa-dc665423e1fc service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.642822 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:06.643554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.644357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:06.644806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.666962 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-e71b4a14-961c-4f0c-a144-f25e8f23f5de req-726de5e7-a61f-4825-93aa-dc665423e1fc service nova] Creating event network-changed:cdf88afb-8339-4273-a911-bc3379093276 for instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e on hv-cinder-75078 May 23 18:21:06.675470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-e71b4a14-961c-4f0c-a144-f25e8f23f5de req-726de5e7-a61f-4825-93aa-dc665423e1fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062330 May 23 18:21:06.682008 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 603/1256] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:06.687508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:21:06.778902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-00d2cc74-a4e3-4475-8515-a27e025a7037 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 204 len: 0 microversion: 2.1 time: 0.167383 May 23 18:21:06.780429 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 654/1257] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:21:06 2022] DELETE /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:21:06.789753 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:06.790650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:06.798631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:06.799129 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.799910 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:06.800486 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:06.947599 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:06.957758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f5270141-7f91-4f63-a62d-ef5d93256ae1 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1578 microversion: 2.1 time: 0.172082 May 23 18:21:06.958404 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 604/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:06 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:21:07.975572 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:07.976306 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:07.982885 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:07.983338 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:07.984702 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:07.985134 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:08.092508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8d18d37e7467f84841ec6ac0080fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc86fccaff473aaa2ee8b35c7a357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:08.101567 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b495b3ea-098a-4393-ad5b-0b78afa31e7e tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 200 len: 1391 microversion: 2.1 time: 0.130154 May 23 18:21:08.102147 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 655/1259] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:07 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 1391 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:08.695207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-bd0e468e-7713-4103-b7c6-d90cb8746687 req-397b1603-acb7-46f4-8457-c21ed2320cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e", "name": "network-vif-deleted", "tag": "cdf88afb-8339-4273-a911-bc3379093276"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:08.704806 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-bd0e468e-7713-4103-b7c6-d90cb8746687 req-397b1603-acb7-46f4-8457-c21ed2320cc8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:08.705246 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-bd0e468e-7713-4103-b7c6-d90cb8746687 req-397b1603-acb7-46f4-8457-c21ed2320cc8 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:08.715932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-bd0e468e-7713-4103-b7c6-d90cb8746687 req-397b1603-acb7-46f4-8457-c21ed2320cc8 service nova] Creating event network-vif-deleted:cdf88afb-8339-4273-a911-bc3379093276 for instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e on hv-cinder-75078 May 23 18:21:08.721406 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-bd0e468e-7713-4103-b7c6-d90cb8746687 req-397b1603-acb7-46f4-8457-c21ed2320cc8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029755 May 23 18:21:08.721986 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 605/1260] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:08.787660 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-68a73f8b-f372-417e-ad8c-3825e758f55b req-ffb66b35-7394-46a5-bdb4-d44310804764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425499e2-c18d-425b-9f3f-3a0ac9d65426", "tag": "14368b46-7e98-4c81-99a9-5e8b1acaf41f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:08.796017 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-68a73f8b-f372-417e-ad8c-3825e758f55b req-ffb66b35-7394-46a5-bdb4-d44310804764 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:08.796469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-68a73f8b-f372-417e-ad8c-3825e758f55b req-ffb66b35-7394-46a5-bdb4-d44310804764 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:08.809698 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-68a73f8b-f372-417e-ad8c-3825e758f55b req-ffb66b35-7394-46a5-bdb4-d44310804764 service nova] Creating event network-changed:14368b46-7e98-4c81-99a9-5e8b1acaf41f for instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 on hv-cinder-75078 May 23 18:21:08.814694 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-68a73f8b-f372-417e-ad8c-3825e758f55b req-ffb66b35-7394-46a5-bdb4-d44310804764 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030700 May 23 18:21:08.815320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 656/1261] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:09.119107 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:09.119815 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:09.126423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:09.126916 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:09.127743 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:09.128184 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:09.144634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] HTTP exception thrown: Instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e could not be found. May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Request method failure captured: May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e HTTP/1.1 May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii84Fo5o7NoIUMuKVO-r3n143JV7ia4m31xCkqj7I2N8_74rhJiXqScVp5ILL7ZdbLD_XNjCu0o92eL-xEvSSfH8WLYdevYPLDAK7jVfkIHG4vZjF_9uumK04eDG6uNMjL3W9RsRWoP7bRdpaQ_7IhmF_-ORw2gEUZ_WXnX4FwaOVdAU May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:21:09.146490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 06b8d18d37e7467f84841ec6ac0080fb May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e could not be found. May 23 18:21:09.148147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e'} May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e could not be found. May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:21:09.148927 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e could not be found. May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e could not be found. May 23 18:21:09.150183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.153179 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Returning 404 to user: Instance 3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:21:09.154047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2a778b88-bf37-4ac6-8963-7a2aa2807d41 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e" status: 404 len: 111 microversion: 2.1 time: 0.039185 May 23 18:21:09.154843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 606/1262] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:09 2022] GET /compute/v2.1/servers/3b3b9c6b-a5cf-4ffb-b9ff-1ef88cc9126e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:21:09.635507 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:09.636096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:09.643143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:09.643592 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:09.644375 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:09.644808 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:09.659476 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] HTTP exception thrown: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Request method failure captured: May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b HTTP/1.1 May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii84Fo5o7NoIUMuKVO-r3n143JV7ia4m31xCkqj7I2N8_74rhJiXqScVp5ILL7ZdbLD_XNjCu0o92eL-xEvSSfH8WLYdevYPLDAK7jVfkIHG4vZjF_9uumK04eDG6uNMjL3W9RsRWoP7bRdpaQ_7IhmF_-ORw2gEUZ_WXnX4FwaOVdAU May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:21:09.661146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 06b8d18d37e7467f84841ec6ac0080fb May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.662780 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'd38d8037-09eb-4c41-b6d8-7a2126321b0b'} May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:21:09.663799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.665131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:21:09.667220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Returning 404 to user: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:21:09.667220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db3fbd4b-c967-4d18-8ae0-3a30789f3eea tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 404 len: 111 microversion: 2.1 time: 0.032098 May 23 18:21:09.667220 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 657/1263] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:21:09 2022] DELETE /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:21:09.672771 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:09.673386 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] [instance: d38d8037-09eb-4c41-b6d8-7a2126321b0b] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:09.679697 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:09.680353 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:09.681161 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:09.681605 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:09.696525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] HTTP exception thrown: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Request method failure captured: May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b HTTP/1.1 May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii84Fo5o7NoIUMuKVO-r3n143JV7ia4m31xCkqj7I2N8_74rhJiXqScVp5ILL7ZdbLD_XNjCu0o92eL-xEvSSfH8WLYdevYPLDAK7jVfkIHG4vZjF_9uumK04eDG6uNMjL3W9RsRWoP7bRdpaQ_7IhmF_-ORw2gEUZ_WXnX4FwaOVdAU May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:21:09.698050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/99bc86fccaff473aaa2ee8b35c7a357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 99bc86fccaff473aaa2ee8b35c7a357f May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-TestVolumeBootPattern-292797858 May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 06b8d18d37e7467f84841ec6ac0080fb May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-TestVolumeBootPattern-292797858-project May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.699646 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'd38d8037-09eb-4c41-b6d8-7a2126321b0b'} May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:21:09.700436 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. May 23 18:21:09.701654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:21:09.703634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Returning 404 to user: Instance d38d8037-09eb-4c41-b6d8-7a2126321b0b could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:21:09.703634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-88525776-f9e7-4ab4-b47c-5ecdd5c39200 tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b" status: 404 len: 111 microversion: 2.1 time: 0.030748 May 23 18:21:09.703634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 607/1264] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:09 2022] GET /compute/v2.1/servers/d38d8037-09eb-4c41-b6d8-7a2126321b0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:21:10.990037 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3946f51e-cc30-4492-928c-c40036fa8a8c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] Calling method '.version_select at 0x7f8c167eb4c0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:11.007675 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3946f51e-cc30-4492-928c-c40036fa8a8c tempest-TestVolumeBootPattern-292797858 tempest-TestVolumeBootPattern-292797858-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1307402015" status: 202 len: 0 microversion: 2.1 time: 0.021432 May 23 18:21:11.008502 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 658/1265] 10.222.0.30 () {58 vars in 1262 bytes} [Mon May 23 18:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1307402015 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:21:16.502580 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:21:16.502580 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:21:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:21:29.923926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a6d09c09-fc5d-4d1b-b52d-fb1a940a95be tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:29.924496 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a6d09c09-fc5d-4d1b-b52d-fb1a940a95be tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:29.927099 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:29.927876 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:29.935890 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6d09c09-fc5d-4d1b-b52d-fb1a940a95be tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:29.936343 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6d09c09-fc5d-4d1b-b52d-fb1a940a95be tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:29.937638 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6d09c09-fc5d-4d1b-b52d-fb1a940a95be tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:29.938084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a6d09c09-fc5d-4d1b-b52d-fb1a940a95be tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:29.964610 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a6d09c09-fc5d-4d1b-b52d-fb1a940a95be tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/ips" status: 200 len: 149 microversion: 2.1 time: 0.044925 May 23 18:21:29.965178 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 608/1266] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:21:29 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:31.299594 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:31.300400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:31.305041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3ae8225f-b19c-4fcb-8c28-d3f9688c1ec6 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9307537-d34a-44f8-8f9b-73809c937013"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:31.306088 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3ae8225f-b19c-4fcb-8c28-d3f9688c1ec6 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:31.314659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ae8225f-b19c-4fcb-8c28-d3f9688c1ec6 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:31.315138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ae8225f-b19c-4fcb-8c28-d3f9688c1ec6 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:31.315908 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ae8225f-b19c-4fcb-8c28-d3f9688c1ec6 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:31.316341 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ae8225f-b19c-4fcb-8c28-d3f9688c1ec6 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:31.556957 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3ae8225f-b19c-4fcb-8c28-d3f9688c1ec6 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258580 May 23 18:21:31.557694 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 659/1267] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:21:31 2022] POST /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:39.046462 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-afe75553-dace-4bd1-93dd-854995508adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: .version_select at 0x7f8c1c3b43a0>, body: {"keypair": {"name": "tempest-keypair-701205180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpcERR1A4xo+PAWrrus3jN64FcW1K1clmh1VvGqjwGxqgLIcmma8g61wsXrnh1FwQCyAy/+aeP2t2WDXuVBZti6RsYU5ruhIGsKQLy7/h+YrwFwD85dCplSb9bWtEBUPw=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:39.060502 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-afe75553-dace-4bd1-93dd-854995508adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:21:39.064648 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-afe75553-dace-4bd1-93dd-854995508adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:21:39.087035 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-afe75553-dace-4bd1-93dd-854995508adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044313 May 23 18:21:39.087647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 609/1268] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:21:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:40.335123 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1948755864", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41737fbe-3e3b-40d5-8d40-17f54e449570"}], "security_groups": [{"name": "tempest-securitygroup--1870533287"}], "key_name": "tempest-keypair-701205180", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:40.436832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] validate_networks() for [('41737fbe-3e3b-40d5-8d40-17f54e449570', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:21:40.908282 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:21:40.908707 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:21:40.909184 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:21:40.909596 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:21:40.910007 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:21:40.918724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:40.919197 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:40.919997 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:40.920433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:40.937760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:21:40.941763 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:21:40.952393 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:21:40.954771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:21:41.000760 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ce6ccb4-cb67-46df-b606-a5e4485c7fa7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.670759 May 23 18:21:41.001437 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 660/1269] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:21:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:21:41.008257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:41.013335 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d085f926-83ad-4325-8995-3e4c5498169d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:41.013950 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d085f926-83ad-4325-8995-3e4c5498169d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:41.068990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d085f926-83ad-4325-8995-3e4c5498169d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:41.076594 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d085f926-83ad-4325-8995-3e4c5498169d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1241 microversion: 2.1 time: 0.069034 May 23 18:21:41.077357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 610/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:41 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:42.093868 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:42.094483 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:42.101682 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:42.102134 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:42.102941 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:42.103382 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:42.165614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:42.173955 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0fe68a36-6cce-4d99-9bb9-0ac4e4582f17 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1299 microversion: 2.1 time: 0.084383 May 23 18:21:42.174519 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 661/1271] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:42 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:43.191333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:43.193407 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:43.200481 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:43.200932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:43.201706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:43.202138 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:43.408270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-d430102e-8cf9-4044-b0d4-006233d54a33 req-287f7b2b-9fc1-41b5-bd9d-d2c806ff4b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320895bb-d8d2-4fd0-a4af-25c7ca81269c", "tag": "f450a0ff-2681-4d1a-aecf-76113ec94a98"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:43.422190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-d430102e-8cf9-4044-b0d4-006233d54a33 req-287f7b2b-9fc1-41b5-bd9d-d2c806ff4b8a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:43.423464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-d430102e-8cf9-4044-b0d4-006233d54a33 req-287f7b2b-9fc1-41b5-bd9d-d2c806ff4b8a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:43.435381 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-d430102e-8cf9-4044-b0d4-006233d54a33 req-287f7b2b-9fc1-41b5-bd9d-d2c806ff4b8a service nova] Creating event network-changed:f450a0ff-2681-4d1a-aecf-76113ec94a98 for instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c on hv-cinder-75078 May 23 18:21:43.441869 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-d430102e-8cf9-4044-b0d4-006233d54a33 req-287f7b2b-9fc1-41b5-bd9d-d2c806ff4b8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048405 May 23 18:21:43.442461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 662/1272] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:43.684593 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:43.692891 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-17520ad6-0987-4605-9136-1a8510361860 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1367 microversion: 2.1 time: 0.506003 May 23 18:21:43.693461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 611/1273] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:43 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1367 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:21:44.711159 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:44.711856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:44.718001 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:44.718449 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:44.719232 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:44.719714 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:44.847354 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:44.855011 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7966aa72-40fc-4019-af4c-89c7cf7494ed tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1367 microversion: 2.1 time: 0.148539 May 23 18:21:44.855566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 663/1274] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:44 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:21:45.871887 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:45.872400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:45.879002 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:45.879454 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:45.880207 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:45.880641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:46.010887 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:46.019233 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f9c81481-a8b1-4944-8bab-ef52e27e5196 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1367 microversion: 2.1 time: 0.151282 May 23 18:21:46.019785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 612/1275] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:45 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:47.035918 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:47.036442 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:47.043099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:47.043548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:47.044305 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:47.044741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:47.179562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:47.186900 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7018b826-5e3c-4caa-8a94-2689f12ebcc9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1367 microversion: 2.1 time: 0.154882 May 23 18:21:47.187467 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 664/1276] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:47 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:48.205003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:48.205616 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:48.212094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:48.212550 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:48.213313 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:48.213750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:48.340411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:48.348000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-49f88685-afc3-4b04-9a09-184f4b04002e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1367 microversion: 2.1 time: 0.147460 May 23 18:21:48.348559 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 613/1277] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:48 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:48.780158 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-696bc805-5bbc-4765-a662-c188a4132251 req-7d2d5d40-20f4-4d53-8e2d-c76dd2b73817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320895bb-d8d2-4fd0-a4af-25c7ca81269c", "name": "network-vif-plugged", "status": "completed", "tag": "f450a0ff-2681-4d1a-aecf-76113ec94a98"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:48.789673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-696bc805-5bbc-4765-a662-c188a4132251 req-7d2d5d40-20f4-4d53-8e2d-c76dd2b73817 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:48.790469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-696bc805-5bbc-4765-a662-c188a4132251 req-7d2d5d40-20f4-4d53-8e2d-c76dd2b73817 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:48.803419 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-696bc805-5bbc-4765-a662-c188a4132251 req-7d2d5d40-20f4-4d53-8e2d-c76dd2b73817 service nova] Creating event network-vif-plugged:f450a0ff-2681-4d1a-aecf-76113ec94a98 for instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c on hv-cinder-75078 May 23 18:21:48.808340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-696bc805-5bbc-4765-a662-c188a4132251 req-7d2d5d40-20f4-4d53-8e2d-c76dd2b73817 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031917 May 23 18:21:48.809074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 665/1278] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:21:49.365321 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:49.365863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:49.372399 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:49.372839 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:49.373590 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:49.374024 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:49.502654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:49.510301 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-47634cc8-dbe4-46aa-b8c1-baebac0eae5b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1367 microversion: 2.1 time: 0.148901 May 23 18:21:49.510882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 614/1279] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:49 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:50.528344 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:50.529030 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:50.536750 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:50.537206 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:50.537992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:50.538414 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:50.675036 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:50.683275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-93b16b92-23aa-4954-a600-3d2de1df2c89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1367 microversion: 2.1 time: 0.159055 May 23 18:21:50.683999 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 666/1280] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:50 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:51.700841 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:51.701453 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:51.703823 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:51.709413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:51.709863 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:51.710618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:51.711077 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:51.843626 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:21:51.851701 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c912e748-7b68-43d7-b3b7-30344d1def71 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1557 microversion: 2.1 time: 0.154699 May 23 18:21:51.852280 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 615/1281] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:21:51 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:21:51.868774 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b85990c4-77ba-433c-aa3e-b945df349e9a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:21:51.869322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b85990c4-77ba-433c-aa3e-b945df349e9a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:21:51.871346 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:51.872161 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:51.878898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b85990c4-77ba-433c-aa3e-b945df349e9a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:51.879342 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b85990c4-77ba-433c-aa3e-b945df349e9a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:51.880106 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b85990c4-77ba-433c-aa3e-b945df349e9a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:51.880531 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b85990c4-77ba-433c-aa3e-b945df349e9a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:51.956633 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b85990c4-77ba-433c-aa3e-b945df349e9a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091650 May 23 18:21:51.957221 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 667/1282] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:21:51 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:21:52.889514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-eab28146-e45e-4c9a-9966-c14f2fc41047 req-a315726c-beb5-4dda-8e95-1bd3b2391c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320895bb-d8d2-4fd0-a4af-25c7ca81269c", "tag": "f450a0ff-2681-4d1a-aecf-76113ec94a98"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:21:52.898760 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-eab28146-e45e-4c9a-9966-c14f2fc41047 req-a315726c-beb5-4dda-8e95-1bd3b2391c13 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:21:52.899239 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-eab28146-e45e-4c9a-9966-c14f2fc41047 req-a315726c-beb5-4dda-8e95-1bd3b2391c13 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:21:52.910741 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-eab28146-e45e-4c9a-9966-c14f2fc41047 req-a315726c-beb5-4dda-8e95-1bd3b2391c13 service nova] Creating event network-changed:f450a0ff-2681-4d1a-aecf-76113ec94a98 for instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c on hv-cinder-75078 May 23 18:21:52.916056 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-eab28146-e45e-4c9a-9966-c14f2fc41047 req-a315726c-beb5-4dda-8e95-1bd3b2391c13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030416 May 23 18:21:52.916974 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 616/1283] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:08.328919 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:08.329689 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:08.333869 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-48f52454-b117-4dbe-a32b-6b2a79831505 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:08.334372 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-48f52454-b117-4dbe-a32b-6b2a79831505 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:08.343024 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48f52454-b117-4dbe-a32b-6b2a79831505 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.343477 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48f52454-b117-4dbe-a32b-6b2a79831505 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.344248 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48f52454-b117-4dbe-a32b-6b2a79831505 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.344691 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48f52454-b117-4dbe-a32b-6b2a79831505 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.372120 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-48f52454-b117-4dbe-a32b-6b2a79831505 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c/ips" status: 200 len: 150 microversion: 2.1 time: 0.045078 May 23 18:23:08.372682 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 668/1284] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:23:08 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:08.381134 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:08.382084 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=32 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:08.387834 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9307537-d34a-44f8-8f9b-73809c937013"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:08.388991 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:08.397022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.397476 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.398452 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.398931 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.658655 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Invalid volume: volume f9307537-d34a-44f8-8f9b-73809c937013 is already attached to instances: 793cf2d1-4755-4a20-a541-f77a7d0f7385 May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: POST /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c/os-volume_attachments HTTP/1.1 May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 74 May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:23:08.660382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {"volumeAttachment": {"volumeId": "f9307537-d34a-44f8-8f9b-73809c937013"}} May 23 18:23:08.661886 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Invalid volume: volume f9307537-d34a-44f8-8f9b-73809c937013 is already attached to instances: 793cf2d1-4755-4a20-a541-f77a7d0f7385 May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '320895bb-d8d2-4fd0-a4af-25c7ca81269c', 'body': {'volumeAttachment': {'volumeId': 'f9307537-d34a-44f8-8f9b-73809c937013'}}} May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f9307537-d34a-44f8-8f9b-73809c937013 is already attached to instances: 793cf2d1-4755-4a20-a541-f77a7d0f7385 May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:23:08.662809 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f9307537-d34a-44f8-8f9b-73809c937013 is already attached to instances: 793cf2d1-4755-4a20-a541-f77a7d0f7385 May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:08.664901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f9307537-d34a-44f8-8f9b-73809c937013 is already attached to instances: 793cf2d1-4755-4a20-a541-f77a7d0f7385 May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 400 to user: Invalid volume: volume f9307537-d34a-44f8-8f9b-73809c937013 is already attached to instances: 793cf2d1-4755-4a20-a541-f77a7d0f7385 {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-28e4b362-3d99-44b4-b63c-fc710b3e3a5c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.282671 May 23 18:23:08.666517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 617/1285] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:23:08 2022] POST /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c/os-volume_attachments => generated 174 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 18:23:08.671056 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:08.671552 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:08.677440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.677890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.678650 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.679731 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.704324 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:23:08.776673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8de081d8-48a8-4c0f-82e5-17025b15cde4 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 204 len: 0 microversion: 2.1 time: 0.109011 May 23 18:23:08.777321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 669/1286] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:23:08 2022] DELETE /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:23:08.785698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:08.786314 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:08.793585 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.794037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.794844 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:08.795283 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:08.930661 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:08.938187 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4cad2712-92ea-42fb-bd51-8841fe59b618 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1682 microversion: 2.1 time: 0.156453 May 23 18:23:08.938761 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 618/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:08 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:09.956173 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:09.956912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:09.963585 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:09.964028 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:09.964775 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:09.965206 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:10.148471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:10.155888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5bb461e0-9c7e-4b73-8570-2878aeb08217 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1682 microversion: 2.1 time: 0.203975 May 23 18:23:10.156443 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 670/1288] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:09 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:11.173864 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:11.174738 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:11.183196 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:11.183640 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:11.184440 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:11.184995 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:11.223424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-d8fb186b-6d06-4f6e-82ab-b27249ff0fef req-5a348bd2-588e-4ad7-9dac-46bcefa3306d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320895bb-d8d2-4fd0-a4af-25c7ca81269c", "name": "network-vif-deleted", "tag": "f450a0ff-2681-4d1a-aecf-76113ec94a98"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:11.232662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-d8fb186b-6d06-4f6e-82ab-b27249ff0fef req-5a348bd2-588e-4ad7-9dac-46bcefa3306d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:11.233117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-d8fb186b-6d06-4f6e-82ab-b27249ff0fef req-5a348bd2-588e-4ad7-9dac-46bcefa3306d service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:11.246960 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-d8fb186b-6d06-4f6e-82ab-b27249ff0fef req-5a348bd2-588e-4ad7-9dac-46bcefa3306d service nova] Creating event network-vif-deleted:f450a0ff-2681-4d1a-aecf-76113ec94a98 for instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c on hv-cinder-75078 May 23 18:23:11.254605 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-d8fb186b-6d06-4f6e-82ab-b27249ff0fef req-5a348bd2-588e-4ad7-9dac-46bcefa3306d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 May 23 18:23:11.255557 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 671/1289] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:11.271412 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:11.280911 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0cd461ce-0252-4bd3-8103-abda264a0f70 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 200 len: 1614 microversion: 2.1 time: 0.111107 May 23 18:23:11.281718 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 619/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:11 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:12.299890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:12.300755 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:12.307819 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:12.308354 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:12.309125 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:12.309563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:12.324441 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c HTTP/1.1 May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:23:12.326084 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:23:12.327777 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '320895bb-d8d2-4fd0-a4af-25c7ca81269c'} May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:23:12.328716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:23:12.330194 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:12.331817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:23:12.331817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f41fd61-1b09-4e89-b7df-32fc9b1bb45c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 404 len: 111 microversion: 2.1 time: 0.032434 May 23 18:23:12.331817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 672/1291] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:12 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:23:12.341077 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-888ff089-33f9-4453-92e3-fd18b6defea7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '.version_select at 0x7f8c202529d0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:12.362549 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-888ff089-33f9-4453-92e3-fd18b6defea7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701205180" status: 202 len: 0 microversion: 2.1 time: 0.029714 May 23 18:23:12.369254 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 620/1292] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 18:23:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701205180 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 18:23:13.010838 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:13.011319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:13.017299 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:13.017747 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:13.018487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:13.018945 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:13.099521 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lazy-loading 'services' on Instance uuid 793cf2d1-4755-4a20-a541-f77a7d0f7385 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:23:13.172305 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-63499cba-2460-4db1-838c-bd68f6531b67 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments/f9307537-d34a-44f8-8f9b-73809c937013" status: 202 len: 0 microversion: 2.1 time: 0.165384 May 23 18:23:13.172905 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 673/1293] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:23:13 2022] DELETE /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments/f9307537-d34a-44f8-8f9b-73809c937013 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:23:13.182555 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-434d1dcb-9b88-41f1-b19d-cc6d9a24c225 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:13.183515 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-434d1dcb-9b88-41f1-b19d-cc6d9a24c225 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:13.190368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-434d1dcb-9b88-41f1-b19d-cc6d9a24c225 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:13.190827 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-434d1dcb-9b88-41f1-b19d-cc6d9a24c225 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:13.191780 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-434d1dcb-9b88-41f1-b19d-cc6d9a24c225 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:13.192237 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-434d1dcb-9b88-41f1-b19d-cc6d9a24c225 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:13.223080 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-434d1dcb-9b88-41f1-b19d-cc6d9a24c225 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 May 23 18:23:13.223632 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 621/1294] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:23:13 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:23:14.236536 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f452e88a-3a62-4f5f-8dd9-abd6e2785e30 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:14.237541 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f452e88a-3a62-4f5f-8dd9-abd6e2785e30 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:14.244273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f452e88a-3a62-4f5f-8dd9-abd6e2785e30 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:14.244719 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f452e88a-3a62-4f5f-8dd9-abd6e2785e30 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:14.245479 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f452e88a-3a62-4f5f-8dd9-abd6e2785e30 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:14.245907 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f452e88a-3a62-4f5f-8dd9-abd6e2785e30 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:14.274571 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f452e88a-3a62-4f5f-8dd9-abd6e2785e30 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042865 May 23 18:23:14.275212 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 674/1295] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:23:14 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:23:14.332071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:14.332582 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:14.339065 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:14.339508 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:14.340258 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:14.340687 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:14.365261 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:23:14.443531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-630f371d-6125-4a4a-b63f-34b4d4890aa8 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 204 len: 0 microversion: 2.1 time: 0.114647 May 23 18:23:14.444425 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 622/1296] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:23:14 2022] DELETE /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:23:14.453255 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:14.453866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:14.459820 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:14.460271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:14.461029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:14.461464 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:14.591493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:14.598813 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-80eb9526-c7db-4a69-9cf7-89878078eed9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1679 microversion: 2.1 time: 0.149593 May 23 18:23:14.599374 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 675/1297] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:14 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:15.617708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:15.618411 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:15.624814 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:15.625259 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:15.626011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:15.626444 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:15.754976 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:15.762913 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5ee5eea7-28d1-44cb-98bb-7ea0a0a4f5eb tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1679 microversion: 2.1 time: 0.149420 May 23 18:23:15.763471 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 623/1298] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:15 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:16.780407 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:16.781042 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:16.787493 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:16.788743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:16.789654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:16.790103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:16.859262 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:16.867800 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0990358f-b5ca-4262-8f2e-2e2684748334 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 200 len: 1612 microversion: 2.1 time: 0.091380 May 23 18:23:16.868359 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 676/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:16 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 1612 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:17.352009 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-8a7b2f93-e864-428a-becb-ddf2e29655c1 req-3fe97d3e-eb3a-4a3d-baf8-936fc3d54272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793cf2d1-4755-4a20-a541-f77a7d0f7385", "name": "network-vif-deleted", "tag": "aea586da-7173-4540-aa53-a24534ffb2c4"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:17.361068 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-8a7b2f93-e864-428a-becb-ddf2e29655c1 req-3fe97d3e-eb3a-4a3d-baf8-936fc3d54272 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:17.361507 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-8a7b2f93-e864-428a-becb-ddf2e29655c1 req-3fe97d3e-eb3a-4a3d-baf8-936fc3d54272 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:17.373804 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-8a7b2f93-e864-428a-becb-ddf2e29655c1 req-3fe97d3e-eb3a-4a3d-baf8-936fc3d54272 service nova] Creating event network-vif-deleted:aea586da-7173-4540-aa53-a24534ffb2c4 for instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 on hv-cinder-75078 May 23 18:23:17.379111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-8a7b2f93-e864-428a-becb-ddf2e29655c1 req-3fe97d3e-eb3a-4a3d-baf8-936fc3d54272 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 May 23 18:23:17.379706 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 624/1300] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:17.886005 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:17.886616 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:17.893213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:17.893602 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:17.894363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:17.894823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:17.907967 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 HTTP/1.1 May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:23:17.909606 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:23:17.911278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '793cf2d1-4755-4a20-a541-f77a7d0f7385'} May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:23:17.912103 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:23:17.913579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:23:17.914736 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:23:17.914736 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5a204b6f-2c26-4e48-aee1-3af80a0e56c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 404 len: 111 microversion: 2.1 time: 0.029936 May 23 18:23:17.914736 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 677/1301] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:17 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 18:23:17.920425 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f41432f8-4e02-49f8-bd4a-54e7fa46de3f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '.version_select at 0x7f8c202cec10>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:17.938400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f41432f8-4e02-49f8-bd4a-54e7fa46de3f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722461495" status: 202 len: 0 microversion: 2.1 time: 0.022037 May 23 18:23:17.939368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 625/1302] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 18:23:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722461495 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:23:18.557810 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-900d1364-bd1b-48f1-b2f1-99c5d627acd3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: .version_select at 0x7f8c1c401160>, body: {"keypair": {"name": "tempest-keypair-1019661141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgFai9O8U6vlPlN3QO5xxid5KZOaWZPUXVhFLTXhPrhqZjm9iPtQmHLgYqbcgwp3ktlmpMki7/2qvB7H7n1MDM19+ej2mfpc/soJREoCLIUjR0daoK173ZX+ZAIuUoKcg=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:18.571920 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-900d1364-bd1b-48f1-b2f1-99c5d627acd3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:23:18.575575 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-900d1364-bd1b-48f1-b2f1-99c5d627acd3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:23:18.596769 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-900d1364-bd1b-48f1-b2f1-99c5d627acd3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043313 May 23 18:23:18.597353 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 678/1303] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:23:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:19.829414 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2140503388", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41737fbe-3e3b-40d5-8d40-17f54e449570"}], "security_groups": [{"name": "tempest-securitygroup--902912335"}], "key_name": "tempest-keypair-1019661141", "user_data": "}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:19.930303 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] validate_networks() for [('41737fbe-3e3b-40d5-8d40-17f54e449570', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:23:20.333915 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:23:20.334337 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:23:20.335253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:23:20.335670 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:23:20.336101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:23:20.344644 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:20.345085 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:20.345865 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:20.346293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:20.363513 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:23:20.368329 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:23:20.378964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:23:20.381268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:23:20.429719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-775d2df2-984b-44e8-a1a0-220539517d97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604508 May 23 18:23:20.430593 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 626/1304] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:23:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 18:23:20.440799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0e17f03e-27eb-47a5-9ffc-e83b50793b2b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:20.441410 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0e17f03e-27eb-47a5-9ffc-e83b50793b2b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:20.494260 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0e17f03e-27eb-47a5-9ffc-e83b50793b2b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:20.501967 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0e17f03e-27eb-47a5-9ffc-e83b50793b2b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1242 microversion: 2.1 time: 0.065564 May 23 18:23:20.502520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 679/1305] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:20 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:21.519793 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:21.520544 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:21.528183 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:21.528640 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:21.529413 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:21.529854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:21.601293 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:21.609724 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d6a1e368-d9df-49b3-9270-ab5bb567857b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1300 microversion: 2.1 time: 0.093893 May 23 18:23:21.610310 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 627/1306] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:21 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:22.627225 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:22.627942 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:22.635310 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:22.635817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:22.637079 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:22.637771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:22.651281 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:22.651934 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:22.674257 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:22.675003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:22.675771 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:22.676203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:22.706659 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lazy-loading 'flavor' on Instance uuid 425499e2-c18d-425b-9f3f-3a0ac9d65426 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:23:22.801289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7ed0d060-dbc3-470a-9248-9ea57280a093 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "POST /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426/action" status: 202 len: 0 microversion: 2.1 time: 0.154754 May 23 18:23:22.806396 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 628/1307] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:23:22 2022] POST /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:23:22.807684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-617c794a-6a66-4344-94fc-c8fdb841a5f1 req-9e657df7-bc7d-4e04-94ee-23d7f7fe481c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a142b0a-d2cf-43f3-b333-c7783001847c", "tag": "6694ed2b-6d6e-4168-862b-471077bee989"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:22.817147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-617c794a-6a66-4344-94fc-c8fdb841a5f1 req-9e657df7-bc7d-4e04-94ee-23d7f7fe481c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:22.817879 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-617c794a-6a66-4344-94fc-c8fdb841a5f1 req-9e657df7-bc7d-4e04-94ee-23d7f7fe481c service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:22.831071 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-617c794a-6a66-4344-94fc-c8fdb841a5f1 req-9e657df7-bc7d-4e04-94ee-23d7f7fe481c service nova] Creating event network-changed:6694ed2b-6d6e-4168-862b-471077bee989 for instance 4a142b0a-d2cf-43f3-b333-c7783001847c on hv-cinder-75078 May 23 18:23:22.838042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-617c794a-6a66-4344-94fc-c8fdb841a5f1 req-9e657df7-bc7d-4e04-94ee-23d7f7fe481c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034676 May 23 18:23:22.839764 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 629/1308] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:22.844733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:22.844957 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:22.845599 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:22.854776 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:22.855253 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:22.855668 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9a612e93-c0d9-463c-af53-4a9b004a96c5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1367 microversion: 2.1 time: 0.231669 May 23 18:23:22.856020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:22.856383 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 680/1309] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:22 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:22.856523 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:23.079117 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:23.087026 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21064bfb-c35a-4c71-be75-b2828441b224 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.246119 May 23 18:23:23.087618 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 630/1310] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:22 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:23.872662 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:23.873203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:23.879651 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:23.880099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:23.880852 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:23.881284 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:24.012043 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:24.019446 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e0d07dab-3c06-453e-85b4-ebb324df96b7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1367 microversion: 2.1 time: 0.150713 May 23 18:23:24.020007 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 681/1311] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:23 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:24.104812 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:24.105427 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:24.111417 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:24.111868 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:24.112628 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:24.113072 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:24.242461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:24.250111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1f1cced3-726f-4be5-b115-3f4aa49d6aa7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.149614 May 23 18:23:24.250748 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 631/1312] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:24 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:25.036817 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:25.037430 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:25.044588 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:25.045035 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:25.045791 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:25.046227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:25.183620 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:25.191141 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7e57084-17d7-4884-9a12-c4efde51e725 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1367 microversion: 2.1 time: 0.158092 May 23 18:23:25.191710 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 682/1313] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:25 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:25.271033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:25.272981 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:25.280394 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:25.280980 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:25.281896 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:25.282441 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:25.498355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:25.505928 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-791e836f-792d-4941-ab4f-243238ceaa2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.238885 May 23 18:23:25.506533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 632/1314] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:25 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:26.208163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:26.208770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:26.216452 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:26.216894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:26.217640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:26.218068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:26.347454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:26.354954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c920e6a-ff32-49a9-b674-a92dbd745dff tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1367 microversion: 2.1 time: 0.150633 May 23 18:23:26.355510 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 683/1315] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:26 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:26.524133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:26.524748 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:26.531384 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:26.531854 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:26.532619 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:26.533056 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:26.659649 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:26.663670 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:26.668833 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b62a793b-84e4-4cc9-8623-b95e92023704 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.149354 May 23 18:23:26.669401 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 633/1316] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:26 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:27.352848 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-c27a70b8-5cec-4190-972f-f7cf8702ea28 req-b15f9621-a3db-45c7-986b-e335b940d573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a142b0a-d2cf-43f3-b333-c7783001847c", "name": "network-vif-plugged", "status": "completed", "tag": "6694ed2b-6d6e-4168-862b-471077bee989"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:27.361953 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c27a70b8-5cec-4190-972f-f7cf8702ea28 req-b15f9621-a3db-45c7-986b-e335b940d573 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:27.362513 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c27a70b8-5cec-4190-972f-f7cf8702ea28 req-b15f9621-a3db-45c7-986b-e335b940d573 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:27.371812 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:27.372463 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:27.376892 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-c27a70b8-5cec-4190-972f-f7cf8702ea28 req-b15f9621-a3db-45c7-986b-e335b940d573 service nova] Creating event network-vif-plugged:6694ed2b-6d6e-4168-862b-471077bee989 for instance 4a142b0a-d2cf-43f3-b333-c7783001847c on hv-cinder-75078 May 23 18:23:27.379523 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:27.380049 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:27.380838 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:27.381901 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:27.382539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-c27a70b8-5cec-4190-972f-f7cf8702ea28 req-b15f9621-a3db-45c7-986b-e335b940d573 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033372 May 23 18:23:27.383427 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 684/1317] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:27.515650 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:27.524128 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1a165ee8-35e7-4e9b-a9fa-deab84e3662c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1367 microversion: 2.1 time: 0.156188 May 23 18:23:27.524750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 634/1318] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:27 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:23:27.687600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:27.688345 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:27.694543 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:27.695015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:27.695765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:27.696192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:27.831574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:27.839684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b4bae95e-6846-44a5-a42d-935fa1d67105 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.156279 May 23 18:23:27.840270 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 685/1319] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:27 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:28.540062 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:28.540750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:28.547352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:28.547807 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:28.548566 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:28.549002 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:28.677525 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:28.685446 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b10ae1a3-9f69-48e5-ac62-68472fb3fb46 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1367 microversion: 2.1 time: 0.149356 May 23 18:23:28.686004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 635/1320] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:28 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:28.857026 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:28.857568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:28.864072 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:28.864520 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:28.865306 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:28.865765 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:28.992888 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:29.000330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0d05a176-1438-4c82-a512-45280814a178 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.147250 May 23 18:23:29.000894 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 686/1321] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:28 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:29.702357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:29.702985 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:29.709842 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:29.710432 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:29.711216 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:29.711656 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:29.839755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:29.847154 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0b8133cd-aad7-4a85-8304-ab47b2b97e15 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1557 microversion: 2.1 time: 0.148683 May 23 18:23:29.847719 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 636/1322] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:29 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:29.863210 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a512229-eb79-46f1-87ef-fd5f41bfc008 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:29.863709 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a512229-eb79-46f1-87ef-fd5f41bfc008 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:29.871083 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a512229-eb79-46f1-87ef-fd5f41bfc008 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:29.871526 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a512229-eb79-46f1-87ef-fd5f41bfc008 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:29.872275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a512229-eb79-46f1-87ef-fd5f41bfc008 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:29.872702 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a512229-eb79-46f1-87ef-fd5f41bfc008 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:29.876297 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:29.951600 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a512229-eb79-46f1-87ef-fd5f41bfc008 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092309 May 23 18:23:29.952196 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 687/1323] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:23:29 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:30.017239 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:30.017849 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:30.023888 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:30.024345 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:30.025114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:30.025557 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:30.165495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:30.173211 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b010b20d-cdac-4a6a-91b4-113794efd6f1 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.159829 May 23 18:23:30.173861 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 637/1324] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:30 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:31.115527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:31.120099 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-25addcfa-8b6a-4345-8f3c-6a293b778c2b req-308506c0-ca00-4f42-933f-a6190d3063b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a142b0a-d2cf-43f3-b333-c7783001847c", "tag": "6694ed2b-6d6e-4168-862b-471077bee989"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:31.128659 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-25addcfa-8b6a-4345-8f3c-6a293b778c2b req-308506c0-ca00-4f42-933f-a6190d3063b7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:31.129095 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-25addcfa-8b6a-4345-8f3c-6a293b778c2b req-308506c0-ca00-4f42-933f-a6190d3063b7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:31.146730 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-25addcfa-8b6a-4345-8f3c-6a293b778c2b req-308506c0-ca00-4f42-933f-a6190d3063b7 service nova] Creating event network-changed:6694ed2b-6d6e-4168-862b-471077bee989 for instance 4a142b0a-d2cf-43f3-b333-c7783001847c on hv-cinder-75078 May 23 18:23:31.157561 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-25addcfa-8b6a-4345-8f3c-6a293b778c2b req-308506c0-ca00-4f42-933f-a6190d3063b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037616 May 23 18:23:31.158331 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 688/1325] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:31.191785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:31.192376 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:31.196402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:31.197429 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:31.202990 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:31.203522 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:31.204356 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:31.205001 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:31.448911 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:31.457165 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9a755f39-98ef-47f5-bbb5-c38372545f72 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.269269 May 23 18:23:31.457736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 638/1326] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:31 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:32.475400 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:32.476645 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:32.484684 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:32.485138 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:32.485902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:32.486340 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:32.620641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:32.628364 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-025e1900-e985-443c-a6b5-7659b598a5cf tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.157489 May 23 18:23:32.628933 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 689/1327] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:32 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:33.646073 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:33.647223 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:33.653275 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:33.653736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:33.654498 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:33.654958 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:33.857288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:33.864853 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-755b0a2e-77f7-464b-bcf3-f656116b27c7 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.222870 May 23 18:23:33.865442 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 639/1328] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:33 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:34.882968 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:34.883579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:34.890317 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:34.890782 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:34.891529 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:34.892047 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:35.024231 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:35.031723 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ebf35eef-a336-491e-9224-9fc66ac1e019 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.153462 May 23 18:23:35.032285 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 690/1329] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:34 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:36.049260 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:36.049830 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:36.056821 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:36.057268 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:36.058022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:36.058461 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:36.188483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:36.196191 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7bc87d78-2f28-4304-a3a6-0303b9dae937 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1508 microversion: 2.1 time: 0.150878 May 23 18:23:36.196748 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 640/1330] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:36 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:36.212693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a0e22fd2-2077-4552-8150-4604bf4fcd09 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:36.213328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a0e22fd2-2077-4552-8150-4604bf4fcd09 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:36.219728 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0e22fd2-2077-4552-8150-4604bf4fcd09 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:36.220171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0e22fd2-2077-4552-8150-4604bf4fcd09 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:36.220916 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0e22fd2-2077-4552-8150-4604bf4fcd09 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:36.221345 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0e22fd2-2077-4552-8150-4604bf4fcd09 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:36.309487 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a0e22fd2-2077-4552-8150-4604bf4fcd09 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "POST /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426/action" status: 202 len: 0 microversion: 2.1 time: 0.100835 May 23 18:23:36.310117 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 691/1331] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 18:23:36 2022] POST /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:23:36.317975 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:36.318614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:36.324495 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:36.324946 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:36.325701 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:36.326133 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:36.467288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:36.475350 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-086cf719-9fef-42ef-82cf-c4cccce9e2cb tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1516 microversion: 2.1 time: 0.160541 May 23 18:23:36.476297 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 641/1332] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:36 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:37.368558 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-16c4628f-0fe2-4eec-8cde-82a5c51bb9fb req-85aba8ee-c4a5-455f-968b-2eee5e65350f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425499e2-c18d-425b-9f3f-3a0ac9d65426", "name": "network-vif-unplugged", "status": "completed", "tag": "14368b46-7e98-4c81-99a9-5e8b1acaf41f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:37.378679 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-16c4628f-0fe2-4eec-8cde-82a5c51bb9fb req-85aba8ee-c4a5-455f-968b-2eee5e65350f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:37.379263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-16c4628f-0fe2-4eec-8cde-82a5c51bb9fb req-85aba8ee-c4a5-455f-968b-2eee5e65350f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:37.391628 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.compute.server_external_events [req-16c4628f-0fe2-4eec-8cde-82a5c51bb9fb req-85aba8ee-c4a5-455f-968b-2eee5e65350f service nova] Unable to find a host for instance 425499e2-c18d-425b-9f3f-3a0ac9d65426. Dropping event network-vif-unplugged {{(pid=117929) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 18:23:37.392642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-16c4628f-0fe2-4eec-8cde-82a5c51bb9fb req-85aba8ee-c4a5-455f-968b-2eee5e65350f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029631 May 23 18:23:37.393321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 692/1333] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 23 18:23:37.493289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:37.493908 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:37.500347 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:37.500800 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:37.501566 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:37.502005 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:37.631493 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:37.639368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6ef026ed-b880-406f-b6f0-a61d762253b6 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.150532 May 23 18:23:37.639955 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 642/1334] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:37 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:38.657674 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:38.658292 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:38.660799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:38.666201 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:38.666648 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:38.667454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:38.668233 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:38.808890 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:38.816336 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3c4b6ae8-1eea-43ae-996a-9fc10903728d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.162563 May 23 18:23:38.816905 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 693/1335] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:38 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:39.833580 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:39.834203 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:39.837047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:39.842357 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:39.842940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:39.843700 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:39.844131 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:39.986526 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:39.994658 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2f7b3be5-da13-4e16-b203-a7a62d0f1f22 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.165059 May 23 18:23:39.995245 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 643/1336] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:39 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:41.012627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:41.013234 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:41.019738 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:41.020186 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:41.020934 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:41.021363 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:41.153111 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:41.162004 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6987b1a6-0945-4b41-8ba7-2dbd5923e878 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.153380 May 23 18:23:41.162788 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 694/1337] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:41 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:42.180635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:42.180635 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:42.187445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:42.187895 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:42.188666 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:42.189101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:42.323289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:42.330769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-813dc2d4-ee7d-425a-a47b-84da2cc4df47 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.154926 May 23 18:23:42.331336 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 644/1338] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:42 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:43.348367 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:43.348974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:43.356309 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:43.356787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:43.357539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:43.357974 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:43.484994 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:43.493136 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6910a848-25dd-48b4-a19d-a8d78624904a tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.148589 May 23 18:23:43.493696 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 695/1339] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:43 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:44.510941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:44.511586 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:44.518067 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:44.518517 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:44.519312 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:44.519750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:44.659554 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:44.667125 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa8df329-54a0-43d4-8a37-f74e0bade82e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.160899 May 23 18:23:44.667685 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 645/1340] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:44 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:45.684716 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:45.685325 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:45.691877 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:45.692319 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:45.693077 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:45.693506 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:45.825322 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:45.832803 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9699d065-b3c8-407e-a3cb-ab3518c4a3f2 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.151950 May 23 18:23:45.833366 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 696/1341] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:45 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:46.849790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:46.850398 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:46.857264 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:46.857708 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:46.858455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:46.858920 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:46.993470 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:47.000954 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1081427a-ab70-42be-9da1-ea42f34d3e27 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.155378 May 23 18:23:47.001531 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 646/1342] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:46 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:47.430548 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-0c632149-a3fb-4aed-9ffe-4406f1934fc3 req-fbdece80-5d9a-487f-a29c-fe98a7c3f073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425499e2-c18d-425b-9f3f-3a0ac9d65426", "name": "network-vif-plugged", "status": "completed", "tag": "14368b46-7e98-4c81-99a9-5e8b1acaf41f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:23:47.439595 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0c632149-a3fb-4aed-9ffe-4406f1934fc3 req-fbdece80-5d9a-487f-a29c-fe98a7c3f073 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:47.440041 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0c632149-a3fb-4aed-9ffe-4406f1934fc3 req-fbdece80-5d9a-487f-a29c-fe98a7c3f073 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:47.454146 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-0c632149-a3fb-4aed-9ffe-4406f1934fc3 req-fbdece80-5d9a-487f-a29c-fe98a7c3f073 service nova] Creating event network-vif-plugged:14368b46-7e98-4c81-99a9-5e8b1acaf41f for instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 on hv-cinder-75078 May 23 18:23:47.459177 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-0c632149-a3fb-4aed-9ffe-4406f1934fc3 req-fbdece80-5d9a-487f-a29c-fe98a7c3f073 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 May 23 18:23:47.459768 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 697/1343] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:23:48.018489 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:48.019060 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:48.026534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:48.027003 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:48.027758 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:48.028191 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:48.156603 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:48.164277 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-72d59255-7df1-40e6-9b23-3f7e2179d833 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.149707 May 23 18:23:48.164836 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 647/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:48 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:49.182305 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:49.183075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:49.189246 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:49.189692 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:49.190440 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:49.190914 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:49.320365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:49.328873 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-269f0319-0ca8-442d-b3e0-259dd32d48b3 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1574 microversion: 2.1 time: 0.151182 May 23 18:23:49.329475 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 698/1345] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:49 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:23:50.348634 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:23:50.349250 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:23:50.356106 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:50.356547 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:50.357298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:23:50.357725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:23:50.489790 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:23:50.497764 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7d5243ff-4fbf-4d48-aedd-631665c04d2e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1561 microversion: 2.1 time: 0.152987 May 23 18:23:50.498325 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 648/1346] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:23:50 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:37.548318 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=11 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:24:37.549244 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:24:37.602535 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-117b5cb1-2474-4e34-8760-35a55691e1a5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:37.603065 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-117b5cb1-2474-4e34-8760-35a55691e1a5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:37.609171 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-117b5cb1-2474-4e34-8760-35a55691e1a5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:37.609614 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-117b5cb1-2474-4e34-8760-35a55691e1a5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:37.610369 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-117b5cb1-2474-4e34-8760-35a55691e1a5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:37.610839 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-117b5cb1-2474-4e34-8760-35a55691e1a5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:37.633946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-117b5cb1-2474-4e34-8760-35a55691e1a5 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/ips" status: 200 len: 148 microversion: 2.1 time: 0.090632 May 23 18:24:37.634527 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 699/1347] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:24:37 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/ips => generated 148 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:24:38.941921 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-380b7e53-0df2-4b17-89b8-73ec37989f3a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2535fef9-06a8-4c49-9397-e5e8253f4756"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:24:38.943051 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-380b7e53-0df2-4b17-89b8-73ec37989f3a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:38.945011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=11 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:24:38.945801 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=90 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:24:38.952769 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-380b7e53-0df2-4b17-89b8-73ec37989f3a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:38.953206 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-380b7e53-0df2-4b17-89b8-73ec37989f3a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:38.953964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-380b7e53-0df2-4b17-89b8-73ec37989f3a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:38.954393 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-380b7e53-0df2-4b17-89b8-73ec37989f3a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:39.188144 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-380b7e53-0df2-4b17-89b8-73ec37989f3a tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250226 May 23 18:24:39.188751 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 649/1348] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:24:38 2022] POST /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:24:46.685978 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2535fef9-06a8-4c49-9397-e5e8253f4756"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:24:46.687113 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:46.695419 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:46.695861 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:46.696611 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:46.697090 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:46.776866 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Invalid volume: volume 2535fef9-06a8-4c49-9397-e5e8253f4756 is already attached to instances: 4a142b0a-d2cf-43f3-b333-c7783001847c May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: POST /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments HTTP/1.1 May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 74 May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:24:46.778546 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {"volumeAttachment": {"volumeId": "2535fef9-06a8-4c49-9397-e5e8253f4756"}} May 23 18:24:46.780399 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Invalid volume: volume 2535fef9-06a8-4c49-9397-e5e8253f4756 is already attached to instances: 4a142b0a-d2cf-43f3-b333-c7783001847c May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '4a142b0a-d2cf-43f3-b333-c7783001847c', 'body': {'volumeAttachment': {'volumeId': '2535fef9-06a8-4c49-9397-e5e8253f4756'}}} May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2535fef9-06a8-4c49-9397-e5e8253f4756 is already attached to instances: 4a142b0a-d2cf-43f3-b333-c7783001847c May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:24:46.781314 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2535fef9-06a8-4c49-9397-e5e8253f4756 is already attached to instances: 4a142b0a-d2cf-43f3-b333-c7783001847c May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:24:46.782902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2535fef9-06a8-4c49-9397-e5e8253f4756 is already attached to instances: 4a142b0a-d2cf-43f3-b333-c7783001847c May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 400 to user: Invalid volume: volume 2535fef9-06a8-4c49-9397-e5e8253f4756 is already attached to instances: 4a142b0a-d2cf-43f3-b333-c7783001847c {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9db0a97b-1ddf-4bcf-824b-be15b02e5827 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097979 May 23 18:24:46.784806 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 700/1349] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:24:46 2022] POST /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 18:24:46.845771 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:46.846343 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:46.852500 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:46.852942 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:46.853842 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:46.854274 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:46.932150 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lazy-loading 'services' on Instance uuid 4a142b0a-d2cf-43f3-b333-c7783001847c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:24:47.002386 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5e8391c4-6539-4a97-8e6e-4c887257ab97 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments/2535fef9-06a8-4c49-9397-e5e8253f4756" status: 202 len: 0 microversion: 2.1 time: 0.161134 May 23 18:24:47.003002 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 650/1350] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:24:46 2022] DELETE /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments/2535fef9-06a8-4c49-9397-e5e8253f4756 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:24:47.012179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32834feb-abfd-481b-a390-0c582c9eb367 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:47.013094 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32834feb-abfd-481b-a390-0c582c9eb367 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:47.020203 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32834feb-abfd-481b-a390-0c582c9eb367 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:47.020651 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32834feb-abfd-481b-a390-0c582c9eb367 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:47.021420 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32834feb-abfd-481b-a390-0c582c9eb367 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:47.021913 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32834feb-abfd-481b-a390-0c582c9eb367 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:47.052836 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32834feb-abfd-481b-a390-0c582c9eb367 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 May 23 18:24:47.053378 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 701/1351] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:24:47 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:24:48.066431 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-016e8562-fabc-4fa5-8df5-927d27de8faf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:48.067514 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-016e8562-fabc-4fa5-8df5-927d27de8faf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:48.073829 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-016e8562-fabc-4fa5-8df5-927d27de8faf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:48.074271 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-016e8562-fabc-4fa5-8df5-927d27de8faf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:48.075052 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-016e8562-fabc-4fa5-8df5-927d27de8faf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:48.075483 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-016e8562-fabc-4fa5-8df5-927d27de8faf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:48.104388 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-016e8562-fabc-4fa5-8df5-927d27de8faf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042765 May 23 18:24:48.104951 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 651/1352] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:24:48 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:24:48.161278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:48.161816 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:48.169287 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:48.169735 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:48.170488 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:48.170946 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:48.195280 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:24:48.268388 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a73864b3-8152-4eb4-aeb2-742eae1e0999 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 204 len: 0 microversion: 2.1 time: 0.110610 May 23 18:24:48.268966 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 702/1353] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:24:48 2022] DELETE /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:24:48.277402 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:48.278106 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:48.284072 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:48.284524 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:48.285284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:48.285722 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:48.413153 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:48.421227 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6812197f-3263-4141-bd97-789d53af1d89 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1680 microversion: 2.1 time: 0.148011 May 23 18:24:48.421785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 652/1354] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:48 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:49.438840 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:49.439469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:49.445896 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:49.446330 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:49.447917 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:49.448494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:49.581503 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:49.589266 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-48c9447b-50c8-4167-831e-20ef76fa0846 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1680 microversion: 2.1 time: 0.154646 May 23 18:24:49.589823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 703/1355] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:49 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:50.606722 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:50.607506 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:50.616425 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:50.617354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:50.619445 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:50.620135 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:50.693575 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:50.705592 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d02b3535-7502-406c-b71e-881805bc1363 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 200 len: 1613 microversion: 2.1 time: 0.103524 May 23 18:24:50.716731 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 653/1356] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:50 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:50.760875 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-5e5a0578-00fb-499a-9368-8ca7b25ae42d req-7593a887-7ed0-46f0-bbb4-b936d9b40613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a142b0a-d2cf-43f3-b333-c7783001847c", "name": "network-vif-deleted", "tag": "6694ed2b-6d6e-4168-862b-471077bee989"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:24:50.769620 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-5e5a0578-00fb-499a-9368-8ca7b25ae42d req-7593a887-7ed0-46f0-bbb4-b936d9b40613 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:50.770075 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-5e5a0578-00fb-499a-9368-8ca7b25ae42d req-7593a887-7ed0-46f0-bbb4-b936d9b40613 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:50.785045 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-5e5a0578-00fb-499a-9368-8ca7b25ae42d req-7593a887-7ed0-46f0-bbb4-b936d9b40613 service nova] Creating event network-vif-deleted:6694ed2b-6d6e-4168-862b-471077bee989 for instance 4a142b0a-d2cf-43f3-b333-c7783001847c on hv-cinder-75078 May 23 18:24:50.791397 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-5e5a0578-00fb-499a-9368-8ca7b25ae42d req-7593a887-7ed0-46f0-bbb4-b936d9b40613 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034190 May 23 18:24:50.794632 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 704/1357] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:24:51.723020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:51.723631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:51.730839 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:51.731288 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:51.732050 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:51.732486 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:51.746115 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c HTTP/1.1 May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:24:51.747778 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:24:51.749516 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '4a142b0a-d2cf-43f3-b333-c7783001847c'} May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:24:51.750392 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:24:51.751847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:24:51.753534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:24:51.753534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-03f9091c-c587-464b-b69a-1fe0c555877c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 404 len: 111 microversion: 2.1 time: 0.030201 May 23 18:24:51.753534 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 654/1358] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:51 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:24:51.759273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-449487d5-0ae3-4f7a-88bd-4e2fed624f19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '.version_select at 0x7f8c166dddc0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:51.778670 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-449487d5-0ae3-4f7a-88bd-4e2fed624f19 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019661141" status: 202 len: 0 microversion: 2.1 time: 0.023557 May 23 18:24:51.779627 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 705/1359] 10.222.0.30 () {58 vars in 1220 bytes} [Mon May 23 18:24:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019661141 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:24:52.387684 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8847bbc2-074e-426e-9643-8d43ba4733fd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: .version_select at 0x7f8c1c3b4940>, body: {"keypair": {"name": "tempest-keypair-679334826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIodNlS5HVF1s/GkLuvXESWls1U5lyrEylwwgRQhYcM5o48V1wnmEvE6rvSiBWDlpQc1lklD43yIMvikHS7+IaAl5buODmpKKuNpkWe2PVkt0m3lztWmlfLfj5/YwA5Gw=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:24:52.402009 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-8847bbc2-074e-426e-9643-8d43ba4733fd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:24:52.405750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-8847bbc2-074e-426e-9643-8d43ba4733fd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:24:52.427299 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8847bbc2-074e-426e-9643-8d43ba4733fd tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044421 May 23 18:24:52.428625 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 655/1360] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 18:24:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:24:53.666534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-191034474", "imageRef": "9a60a98b-79f7-4bf7-acfb-232011a3bbce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41737fbe-3e3b-40d5-8d40-17f54e449570"}], "security_groups": [{"name": "tempest-securitygroup--133303971"}], "key_name": "tempest-keypair-679334826", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:24:53.768471 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] validate_networks() for [('41737fbe-3e3b-40d5-8d40-17f54e449570', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 18:24:54.126741 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 18:24:54.127176 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 18:24:54.127652 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 18:24:54.128066 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 18:24:54.128485 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 18:24:54.138071 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:54.138522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:54.139353 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:54.139792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:54.156110 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 18:24:54.160086 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Getting quotas for user 9ce04aa758ca400786dfcc5e13d0cf10 and project 0b2219c143d44ab09672beca155dfaca. Resources: {'instances', 'cores', 'ram'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 18:24:54.171190 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 18:24:54.173509 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a60a98b-79f7-4bf7-acfb-232011a3bbce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 18:24:54.219534 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-677b025f-0e7b-4099-bb40-1d05d4f3f42e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.557267 May 23 18:24:54.220167 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 706/1361] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 18:24:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 18:24:54.230728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4d42a0bc-6875-48d9-a589-34b2885da5d9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:54.231355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4d42a0bc-6875-48d9-a589-34b2885da5d9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:54.284755 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4d42a0bc-6875-48d9-a589-34b2885da5d9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:54.291750 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4d42a0bc-6875-48d9-a589-34b2885da5d9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1240 microversion: 2.1 time: 0.065596 May 23 18:24:54.292331 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 656/1362] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:54 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:55.318213 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:55.318893 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:55.325835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:55.326275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:55.327068 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:55.327497 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:55.395031 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:55.402880 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd7e17be-f257-4957-9fcf-01ad0f8207af tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1298 microversion: 2.1 time: 0.088885 May 23 18:24:55.403461 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 707/1363] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:55 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:56.420946 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:56.422205 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:56.428792 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:56.429569 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:56.430368 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:56.430839 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:56.546131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-a60bf882-a0fc-41f9-9d02-6899622d9125 req-eb4ca806-0cf9-4159-8ef5-1d164843bf07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f75624-40ae-4abb-bdd6-c9048f684903", "tag": "3651779d-0004-4edb-8b32-3e55291bd0d4"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:24:56.574271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-a60bf882-a0fc-41f9-9d02-6899622d9125 req-eb4ca806-0cf9-4159-8ef5-1d164843bf07 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:56.574981 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-a60bf882-a0fc-41f9-9d02-6899622d9125 req-eb4ca806-0cf9-4159-8ef5-1d164843bf07 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:56.589779 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-a60bf882-a0fc-41f9-9d02-6899622d9125 req-eb4ca806-0cf9-4159-8ef5-1d164843bf07 service nova] Creating event network-changed:3651779d-0004-4edb-8b32-3e55291bd0d4 for instance d2f75624-40ae-4abb-bdd6-c9048f684903 on hv-cinder-75078 May 23 18:24:56.595140 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-a60bf882-a0fc-41f9-9d02-6899622d9125 req-eb4ca806-0cf9-4159-8ef5-1d164843bf07 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056481 May 23 18:24:56.595746 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 708/1364] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 18:24:56.941674 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:56.950002 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e9b5406-b157-4474-a1f9-d9e00dc7751d tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.532867 May 23 18:24:56.951033 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 657/1365] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:56 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:57.967871 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:57.968568 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:57.975251 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:57.975693 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:57.976444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:57.976872 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:58.102639 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:58.111139 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32e13248-da71-47f5-820a-a6f15237b8d3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.147450 May 23 18:24:58.111705 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 709/1366] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:57 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:24:59.128418 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:24:59.129114 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:24:59.136654 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:59.137100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:59.137860 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:24:59.138289 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:24:59.366964 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:24:59.374936 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9fcd43a5-2f91-4870-8d07-31f56bb42b8f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.250352 May 23 18:24:59.375491 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 658/1367] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:24:59 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:00.392456 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:00.393062 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:00.399643 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:00.400761 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:00.401553 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:00.401992 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:00.530469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:00.537811 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5aa1e5df-df2f-407c-8037-846e14d8c9ee tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.149164 May 23 18:25:00.538360 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 710/1368] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:00 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:01.554119 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:01.554828 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:01.561926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:01.562381 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:01.563197 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:01.563639 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:01.694736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:01.702405 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f3dc3fd8-f7b1-4c17-b8ba-7c2541b16da1 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.152203 May 23 18:25:01.703020 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 659/1369] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:01 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:02.718504 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:02.719135 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:02.725669 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:02.726116 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:02.726902 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:02.727339 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:02.856832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:02.864116 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c987652-61a4-4474-ac17-999c858671c3 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.149481 May 23 18:25:02.864837 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 711/1370] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:02 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:03.866442 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-a086cbce-212b-44d3-8be1-4874a4df36cd req-e044b6de-6c9a-4c95-ae73-4880bda3998f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f75624-40ae-4abb-bdd6-c9048f684903", "name": "network-vif-plugged", "status": "completed", "tag": "3651779d-0004-4edb-8b32-3e55291bd0d4"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:25:03.875294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-a086cbce-212b-44d3-8be1-4874a4df36cd req-e044b6de-6c9a-4c95-ae73-4880bda3998f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:03.875766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-a086cbce-212b-44d3-8be1-4874a4df36cd req-e044b6de-6c9a-4c95-ae73-4880bda3998f service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:03.881252 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:03.881879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:03.888040 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-a086cbce-212b-44d3-8be1-4874a4df36cd req-e044b6de-6c9a-4c95-ae73-4880bda3998f service nova] Creating event network-vif-plugged:3651779d-0004-4edb-8b32-3e55291bd0d4 for instance d2f75624-40ae-4abb-bdd6-c9048f684903 on hv-cinder-75078 May 23 18:25:03.889724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:03.890179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:03.890979 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:03.891421 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:03.893415 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-a086cbce-212b-44d3-8be1-4874a4df36cd req-e044b6de-6c9a-4c95-ae73-4880bda3998f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090845 May 23 18:25:03.894000 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 660/1371] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:25:04.032771 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:04.040736 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e6e8d898-4141-4012-828c-b7d2d6840105 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.163121 May 23 18:25:04.041321 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 712/1372] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:03 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:25:05.055134 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:05.060333 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:05.061037 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:05.067529 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:05.067977 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:05.068734 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:05.069173 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:05.201556 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:05.208969 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-087dd2b4-74c1-493e-9f55-96e12f8f3305 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1365 microversion: 2.1 time: 0.154878 May 23 18:25:05.209530 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 661/1373] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:05 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:06.226655 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:06.227291 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:06.229500 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:06.230133 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:06.237296 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:06.237743 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:06.238494 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:06.238944 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:06.366089 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:06.374141 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-408e96c4-79fc-458c-8378-240336014e43 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1555 microversion: 2.1 time: 0.151353 May 23 18:25:06.374726 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 713/1374] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:06 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:06.390469 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3ac8218a-487e-4908-b4cf-40ced6d22c0e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:06.391022 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3ac8218a-487e-4908-b4cf-40ced6d22c0e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:06.397270 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3ac8218a-487e-4908-b4cf-40ced6d22c0e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:06.397713 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3ac8218a-487e-4908-b4cf-40ced6d22c0e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:06.398462 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3ac8218a-487e-4908-b4cf-40ced6d22c0e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:06.398926 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3ac8218a-487e-4908-b4cf-40ced6d22c0e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:06.479162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3ac8218a-487e-4908-b4cf-40ced6d22c0e tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092406 May 23 18:25:06.479704 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 662/1375] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 18:25:06 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:25:07.516433 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-0e551b0a-b431-408a-9a8f-09fa7961ec80 req-3c96a412-5f3a-44fa-932b-d90da5775026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f75624-40ae-4abb-bdd6-c9048f684903", "tag": "3651779d-0004-4edb-8b32-3e55291bd0d4"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:25:07.525254 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0e551b0a-b431-408a-9a8f-09fa7961ec80 req-3c96a412-5f3a-44fa-932b-d90da5775026 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:07.525701 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0e551b0a-b431-408a-9a8f-09fa7961ec80 req-3c96a412-5f3a-44fa-932b-d90da5775026 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:07.537155 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-0e551b0a-b431-408a-9a8f-09fa7961ec80 req-3c96a412-5f3a-44fa-932b-d90da5775026 service nova] Creating event network-changed:3651779d-0004-4edb-8b32-3e55291bd0d4 for instance d2f75624-40ae-4abb-bdd6-c9048f684903 on hv-cinder-75078 May 23 18:25:07.542263 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-0e551b0a-b431-408a-9a8f-09fa7961ec80 req-3c96a412-5f3a-44fa-932b-d90da5775026 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029847 May 23 18:25:07.542879 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 714/1376] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:25:20.396290 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:20.397423 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:20.401272 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:20.401796 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:20.403701 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-448028bd-8bc7-41d2-9f20-1e02ecad0212 req-51414e6f-b014-4587-9c49-7f81e284555a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425499e2-c18d-425b-9f3f-3a0ac9d65426", "tag": "14368b46-7e98-4c81-99a9-5e8b1acaf41f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:25:20.408937 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:20.409717 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:20.409862 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:20.410176 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:20.411222 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:20.411476 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:20.418883 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-448028bd-8bc7-41d2-9f20-1e02ecad0212 req-51414e6f-b014-4587-9c49-7f81e284555a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:20.419324 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-448028bd-8bc7-41d2-9f20-1e02ecad0212 req-51414e6f-b014-4587-9c49-7f81e284555a service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:20.436325 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-448028bd-8bc7-41d2-9f20-1e02ecad0212 req-51414e6f-b014-4587-9c49-7f81e284555a service nova] Creating event network-changed:14368b46-7e98-4c81-99a9-5e8b1acaf41f for instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 on hv-cinder-75078 May 23 18:25:20.438469 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:25:20.442192 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-448028bd-8bc7-41d2-9f20-1e02ecad0212 req-51414e6f-b014-4587-9c49-7f81e284555a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044229 May 23 18:25:20.443206 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 715/1377] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:25:20.523954 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d136bb35-5168-4fa5-bdc1-d7d39c56116e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "DELETE /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 204 len: 0 microversion: 2.1 time: 0.128584 May 23 18:25:20.524947 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 663/1378] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:25:20 2022] DELETE /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:25:20.533784 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:20.534491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:20.544253 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:20.544770 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:20.546328 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:20.547096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:20.686835 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:20.694275 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3cdf2937-5809-461e-974c-6ac7e86dbb9d tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.165013 May 23 18:25:20.694853 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 716/1379] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:20 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 18:25:21.714028 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:21.714794 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:21.721162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:21.721614 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:21.722400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:21.722873 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:21.896882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:21.904455 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bbaa8537-2da1-440f-9dd5-3796e5ee2fd8 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1567 microversion: 2.1 time: 0.194769 May 23 18:25:21.905027 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 664/1380] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:21 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:22.655067 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-f98ce25b-9d28-4c97-a6ed-92801ed80006 req-f9ac9fb1-3563-49ef-a474-32486e9a97d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425499e2-c18d-425b-9f3f-3a0ac9d65426", "name": "network-vif-deleted", "tag": "14368b46-7e98-4c81-99a9-5e8b1acaf41f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:25:22.663124 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f98ce25b-9d28-4c97-a6ed-92801ed80006 req-f9ac9fb1-3563-49ef-a474-32486e9a97d7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:22.663574 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f98ce25b-9d28-4c97-a6ed-92801ed80006 req-f9ac9fb1-3563-49ef-a474-32486e9a97d7 service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:22.675592 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-f98ce25b-9d28-4c97-a6ed-92801ed80006 req-f9ac9fb1-3563-49ef-a474-32486e9a97d7 service nova] Creating event network-vif-deleted:14368b46-7e98-4c81-99a9-5e8b1acaf41f for instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 on hv-cinder-75078 May 23 18:25:22.680357 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-f98ce25b-9d28-4c97-a6ed-92801ed80006 req-f9ac9fb1-3563-49ef-a474-32486e9a97d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028954 May 23 18:25:22.681642 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 717/1381] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:25:22.921923 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:22.922565 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:22.929147 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:22.929584 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:22.930354 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:22.930882 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:22.999669 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8e89084a2344cdb89889d7d5744b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4b5edf7a064c2eb276bdf2c418f26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:25:23.008499 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-732093e4-52c6-4e87-bd7a-77cd94e71c26 tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 200 len: 1219 microversion: 2.1 time: 0.089661 May 23 18:25:23.009639 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 665/1382] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:22 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:25:24.026986 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:24.027683 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] [instance: 425499e2-c18d-425b-9f3f-3a0ac9d65426] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:25:24.033823 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:24.034271 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:24.035131 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:25:24.035561 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:25:24.048473 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] HTTP exception thrown: Instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 could not be found. May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Request method failure captured: May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 HTTP/1.1 May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9Bdnk0HiR7nPh2cvi2P9D59vQi3mkdxsFwea2CQ6-OzEcD8Tqbw0bG-boRZjzGLyBovHr0Fuv1zh6CA38MzU-mbEwGZMQKgrbGE2siKhNf7HENnBFaxNMsjVEuk4b3tHdtfPuIRGGhMp9ccjMcyb7xv054v6zMTH2v-q5TJGtmH3ro May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 9b4b5edf7a064c2eb276bdf2c418f26e May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-TestShelveInstance-370472660 May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:25:24.050053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9b4b5edf7a064c2eb276bdf2c418f26e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9b4b5edf7a064c2eb276bdf2c418f26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9b4b5edf7a064c2eb276bdf2c418f26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9b4b5edf7a064c2eb276bdf2c418f26e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-TestShelveInstance-370472660 May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 9b4b5edf7a064c2eb276bdf2c418f26e May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-TestShelveInstance-370472660 May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-TestShelveInstance-370472660-project May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 2f8e89084a2344cdb89889d7d5744b8b May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-TestShelveInstance-370472660-project May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 could not be found. May 23 18:25:24.051787 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '425499e2-c18d-425b-9f3f-3a0ac9d65426'} May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 could not be found. May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:25:24.052863 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 could not be found. May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 could not be found. May 23 18:25:24.054512 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:25:24.055990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Returning 404 to user: Instance 425499e2-c18d-425b-9f3f-3a0ac9d65426 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:25:24.055990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-42d8a6cb-c71b-4635-bbff-ec61ec76d50f tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426" status: 404 len: 111 microversion: 2.1 time: 0.029204 May 23 18:25:24.055990 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 718/1383] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:25:24 2022] GET /compute/v2.1/servers/425499e2-c18d-425b-9f3f-3a0ac9d65426 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:25:24.218629 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b983b9f-4eb6-4cb5-8dc2-8be70f34268e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] Calling method '.version_select at 0x7f8c20252430>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:25:24.239146 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b983b9f-4eb6-4cb5-8dc2-8be70f34268e tempest-TestShelveInstance-370472660 tempest-TestShelveInstance-370472660-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-653903503" status: 202 len: 0 microversion: 2.1 time: 0.024306 May 23 18:25:24.239725 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 666/1384] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 18:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-653903503 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:26:06.979932 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:26:06.980631 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Mon May 23 18:26:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:26:10.996278 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-89bc4641-2972-4a41-a0f2-6f0efae69eef tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:10.996856 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-89bc4641-2972-4a41-a0f2-6f0efae69eef tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:10.998970 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=8 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:10.999610 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=12 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:11.005695 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bc4641-2972-4a41-a0f2-6f0efae69eef tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:11.006142 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bc4641-2972-4a41-a0f2-6f0efae69eef tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:11.006929 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bc4641-2972-4a41-a0f2-6f0efae69eef tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:11.007365 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bc4641-2972-4a41-a0f2-6f0efae69eef tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:11.031511 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-89bc4641-2972-4a41-a0f2-6f0efae69eef tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/ips" status: 200 len: 149 microversion: 2.1 time: 0.039150 May 23 18:26:11.032067 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 719/1385] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 18:26:10 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:26:12.344783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:12.345533 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:12.349690 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ecf2ea8d-8fca-4472-afd9-3e839b0db509 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b3570e6-7425-411b-8695-58359e026161"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:26:12.350795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ecf2ea8d-8fca-4472-afd9-3e839b0db509 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:12.358728 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecf2ea8d-8fca-4472-afd9-3e839b0db509 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:12.359299 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecf2ea8d-8fca-4472-afd9-3e839b0db509 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:12.360066 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecf2ea8d-8fca-4472-afd9-3e839b0db509 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:12.360505 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecf2ea8d-8fca-4472-afd9-3e839b0db509 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:12.596342 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ecf2ea8d-8fca-4472-afd9-3e839b0db509 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "POST /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252818 May 23 18:26:12.596875 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 667/1386] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 18:26:12 2022] POST /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:26:20.181105 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:20.181641 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:20.188836 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:20.189288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:20.190122 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:20.190563 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:20.271179 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lazy-loading 'services' on Instance uuid d2f75624-40ae-4abb-bdd6-c9048f684903 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 18:26:20.340724 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9dd28ae7-4490-4311-8f34-e5db33571981 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments/3b3570e6-7425-411b-8695-58359e026161" status: 202 len: 0 microversion: 2.1 time: 0.163227 May 23 18:26:20.341335 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 720/1387] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 18:26:20 2022] DELETE /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments/3b3570e6-7425-411b-8695-58359e026161 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:26:20.350831 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f5ec1268-23fe-41cd-a7e6-d4c0e073da2f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:20.351848 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f5ec1268-23fe-41cd-a7e6-d4c0e073da2f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:20.358324 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ec1268-23fe-41cd-a7e6-d4c0e073da2f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:20.358795 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ec1268-23fe-41cd-a7e6-d4c0e073da2f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:20.359570 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ec1268-23fe-41cd-a7e6-d4c0e073da2f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:20.360004 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ec1268-23fe-41cd-a7e6-d4c0e073da2f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:20.395739 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f5ec1268-23fe-41cd-a7e6-d4c0e073da2f tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049680 May 23 18:26:20.396478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 668/1388] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:26:20 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:26:21.408521 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3d58dcc2-14bf-4566-bbdc-73da861b7adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:21.409578 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3d58dcc2-14bf-4566-bbdc-73da861b7adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:21.415880 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d58dcc2-14bf-4566-bbdc-73da861b7adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:21.416279 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d58dcc2-14bf-4566-bbdc-73da861b7adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:21.417038 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d58dcc2-14bf-4566-bbdc-73da861b7adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:21.417469 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d58dcc2-14bf-4566-bbdc-73da861b7adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:21.449013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3d58dcc2-14bf-4566-bbdc-73da861b7adf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044228 May 23 18:26:21.449013 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 721/1389] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 18:26:21 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 18:26:21.506989 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:21.507564 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:21.516460 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:21.517205 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:21.518400 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:21.518900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:21.547299 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 18:26:21.620647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-48ee9fdd-1561-48ff-b581-0d50a6f12968 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 204 len: 0 microversion: 2.1 time: 0.117168 May 23 18:26:21.621766 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 669/1390] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:26:21 2022] DELETE /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 18:26:21.630163 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:21.630799 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:21.637688 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:21.638143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:21.638934 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:21.639367 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:21.769417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:26:21.776792 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12384d25-390a-4be9-a459-b30e9f22abde tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1679 microversion: 2.1 time: 0.150730 May 23 18:26:21.777368 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 722/1391] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:21 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:26:22.794138 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:22.794811 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:22.801383 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:22.801843 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:22.802593 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:22.803053 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:22.933941 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:26:22.941330 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b9b2c319-9f4c-49ff-bc65-7bc14227327c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1679 microversion: 2.1 time: 0.151649 May 23 18:26:22.941883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 670/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:22 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:26:23.959405 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:23.960023 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:23.966562 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:23.967053 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:23.967832 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:23.968273 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:24.286015 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce04aa758ca400786dfcc5e13d0cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2219c143d44ab09672beca155dfaca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} May 23 18:26:24.294912 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e6fcd119-da5a-4efe-bc22-16286de7650c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 200 len: 1612 microversion: 2.1 time: 0.339479 May 23 18:26:24.295499 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 723/1393] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:23 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 1612 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 18:26:24.609608 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-351c7dd6-f25f-4721-9736-161b76eaa900 req-194a21df-45b1-4f7a-9bff-9ed7e0033d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f75624-40ae-4abb-bdd6-c9048f684903", "name": "network-vif-deleted", "tag": "3651779d-0004-4edb-8b32-3e55291bd0d4"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 18:26:24.619781 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-351c7dd6-f25f-4721-9736-161b76eaa900 req-194a21df-45b1-4f7a-9bff-9ed7e0033d5e service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:24.620355 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-351c7dd6-f25f-4721-9736-161b76eaa900 req-194a21df-45b1-4f7a-9bff-9ed7e0033d5e service nova] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:24.631641 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-351c7dd6-f25f-4721-9736-161b76eaa900 req-194a21df-45b1-4f7a-9bff-9ed7e0033d5e service nova] Creating event network-vif-deleted:3651779d-0004-4edb-8b32-3e55291bd0d4 for instance d2f75624-40ae-4abb-bdd6-c9048f684903 on hv-cinder-75078 May 23 18:26:24.636993 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-351c7dd6-f25f-4721-9736-161b76eaa900 req-194a21df-45b1-4f7a-9bff-9ed7e0033d5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173056 May 23 18:26:24.637653 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 671/1394] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 18:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 18:26:25.312654 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:25.313277 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:25.319892 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:25.320339 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:25.321108 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:25.321539 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:25.335987 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 HTTP/1.1 May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:26:25.337673 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:25.339491 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'd2f75624-40ae-4abb-bdd6-c9048f684903'} May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:25.340386 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:25.341842 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:25.343143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:25.343143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e613676a-620d-4f00-a613-6e8c682946a7 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 404 len: 111 microversion: 2.1 time: 0.031068 May 23 18:26:25.343143 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 724/1395] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:25 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:26:25.348899 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8905fbdf-ecb7-44a1-a6e4-5bdd5ef63994 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '.version_select at 0x7f8c201eb280>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:25.366490 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8905fbdf-ecb7-44a1-a6e4-5bdd5ef63994 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679334826" status: 202 len: 0 microversion: 2.1 time: 0.021676 May 23 18:26:25.367361 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 672/1396] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 18:26:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679334826 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 18:26:27.125424 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:27.126517 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:27.133006 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:27.133450 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:27.134208 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:27.134640 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:27.148300 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 HTTP/1.1 May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:26:27.149859 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.151523 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': 'd2f75624-40ae-4abb-bdd6-c9048f684903'} May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:27.152425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.154489 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:27.156076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:27.156076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b3822adb-eea2-480e-ac4f-fb099e6fbbe9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 404 len: 111 microversion: 2.1 time: 0.030029 May 23 18:26:27.156076 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 725/1397] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:26:27 2022] DELETE /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:26:27.161841 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:27.162568 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: d2f75624-40ae-4abb-bdd6-c9048f684903] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:27.168672 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:27.169835 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:27.170588 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:27.171047 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:27.183959 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 HTTP/1.1 May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:26:27.185783 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.187478 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': 'd2f75624-40ae-4abb-bdd6-c9048f684903'} May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:27.188467 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. May 23 18:26:27.190094 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:27.191661 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance d2f75624-40ae-4abb-bdd6-c9048f684903 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:27.191661 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f7ba0d05-6b80-4dc1-8330-8b1e4273cbaf tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903" status: 404 len: 111 microversion: 2.1 time: 0.029753 May 23 18:26:27.191661 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 673/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:27 2022] GET /compute/v2.1/servers/d2f75624-40ae-4abb-bdd6-c9048f684903 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:26:28.318708 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:28.319217 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:28.326824 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.327264 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.328020 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.328444 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.342579 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c HTTP/1.1 May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:26:28.344166 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.345898 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '4a142b0a-d2cf-43f3-b333-c7783001847c'} May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:28.346895 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.348508 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.350074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:28.350074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-33336b10-e14a-4eed-b4b4-2699934dc14b tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 404 len: 111 microversion: 2.1 time: 0.030662 May 23 18:26:28.350074 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 726/1399] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:26:28 2022] DELETE /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:26:28.353785 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:28.354406 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 4a142b0a-d2cf-43f3-b333-c7783001847c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:28.361845 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.362298 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.363101 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.363538 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.381397 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c HTTP/1.1 May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:26:28.383011 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.384736 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '4a142b0a-d2cf-43f3-b333-c7783001847c'} May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:28.386111 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. May 23 18:26:28.387883 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.389352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 4a142b0a-d2cf-43f3-b333-c7783001847c could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:28.389352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4136a360-9753-4bf7-b478-94dc7ffcead2 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c" status: 404 len: 111 microversion: 2.1 time: 0.034482 May 23 18:26:28.389352 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 674/1400] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:28 2022] GET /compute/v2.1/servers/4a142b0a-d2cf-43f3-b333-c7783001847c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:26:28.397320 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:28.397812 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:28.404657 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.405097 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.405852 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.406283 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.421784 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c HTTP/1.1 May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:26:28.423329 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.425029 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '320895bb-d8d2-4fd0-a4af-25c7ca81269c'} May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:28.426227 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.427954 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:28.429603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:28.429603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ccc0fe63-f9fc-48c0-aa00-a015a2c343e9 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 404 len: 111 microversion: 2.1 time: 0.031235 May 23 18:26:28.429603 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 727/1401] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:26:28 2022] DELETE /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 18:26:28.433231 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:28.433539 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 320895bb-d8d2-4fd0-a4af-25c7ca81269c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:28.439640 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.440091 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.440847 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:28.441284 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:28.454382 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c HTTP/1.1 May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:26:28.455900 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.457607 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '320895bb-d8d2-4fd0-a4af-25c7ca81269c'} May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:28.458729 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. May 23 18:26:28.460162 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:28.462169 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 320895bb-d8d2-4fd0-a4af-25c7ca81269c could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:28.462169 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a3c28db6-348b-4184-8b3b-7f2acaf4ba65 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c" status: 404 len: 111 microversion: 2.1 time: 0.028054 May 23 18:26:28.462169 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 675/1402] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:28 2022] GET /compute/v2.1/servers/320895bb-d8d2-4fd0-a4af-25c7ca81269c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:26:29.588959 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:29.589454 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:29.595903 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:29.596345 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:29.597096 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:29.597522 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:29.611125 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 HTTP/1.1 May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept: application/json May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Connection: close May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Length: 0 May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Content-Type: application/json May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Host: 10.222.0.30 May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.9 May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Id: None May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Domain-Name: None May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Role: member,reader May 23 18:26:29.612622 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Roles: member,reader May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: method: > May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: exception: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.614288 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: action_args: {'id': '793cf2d1-4755-4a20-a541-f77a7d0f7385'} May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:29.615417 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.617070 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi May 23 18:26:29.618612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:29.618612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-641c7c87-da65-4591-bc25-0649b3f3e48c tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 404 len: 111 microversion: 2.1 time: 0.028784 May 23 18:26:29.618612 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 728/1403] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 18:26:29 2022] DELETE /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:26:29.622043 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 18:26:29.622647 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] [instance: 793cf2d1-4755-4a20-a541-f77a7d0f7385] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 18:26:29.629637 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:29.630078 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:29.630861 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 18:26:29.631294 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Lock "b13b6f0a-8239-4130-98e7-0248b4fd2533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 18:26:29.644595 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] HTTP exception thrown: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Request method failure captured: May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 HTTP/1.1 May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept: application/json May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Connection: close May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Length: 0 May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Content-Type: application/json May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Host: 10.222.0.30 May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.9 May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABii9A5hZpPoaTgSNpnp11b737MZF_l-og-OypCIBLEAVT1KKXBwGSdyZdx48WgJIVN03SpYa3jxQtJHv_eqa6i6QBONgE9xajBnLVky1PnuYKiJJzPyku-YHyoOC5tzmlzRxESg03jB-yOOo2hvzMCqZ4VuHxOt2tKxTJ_NWU5mAgmGLo May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Id: None May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Domain-Name: None May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Role: member,reader May 23 18:26:29.646079 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Roles: member,reader May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b2219c143d44ab09672beca155dfaca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b2219c143d44ab09672beca155dfaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}] May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0b2219c143d44ab09672beca155dfaca May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-986595625 May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Id: 9ce04aa758ca400786dfcc5e13d0cf10 May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-986595625-project May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: method: > May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: exception: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.647789 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: action_args: {'id': '793cf2d1-4755-4a20-a541-f77a7d0f7385'} May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 18:26:29.648698 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. May 23 18:26:29.650042 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi May 23 18:26:29.651371 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] Returning 404 to user: Instance 793cf2d1-4755-4a20-a541-f77a7d0f7385 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 18:26:29.651371 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-db660466-2650-49ad-b491-1fe4d3ef6738 tempest-AttachVolumeNegativeTest-986595625 tempest-AttachVolumeNegativeTest-986595625-project] 10.222.0.30 "GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385" status: 404 len: 111 microversion: 2.1 time: 0.029133 May 23 18:26:29.651371 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 676/1404] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 18:26:29 2022] GET /compute/v2.1/servers/793cf2d1-4755-4a20-a541-f77a7d0f7385 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 18:27:56.515425 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:27:56.516073 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:28:04.238078 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:28:04.238846 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:28:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:29:26.988940 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:29:26.989776 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Mon May 23 18:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:29:37.340558 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:29:37.341100 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Mon May 23 18:29:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:31:16.525554 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:31:16.526007 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:31:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:31:24.245733 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:31:24.246411 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:31:26.025566 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:31:26.026229 dv-cinder-750782-23-iscsi devstack@n-api.service[117929]: Mon May 23 18:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 18:31:33.740214 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 18:31:33.740784 dv-cinder-750782-23-iscsi devstack@n-api.service[117928]: Mon May 23 18:31:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!